You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/03/04 17:03:34 UTC
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 532 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/532/
1 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch
Error Message:
Error executing query
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Error executing query
at __randomizedtesting.SeedInfo.seed([5A2311D2E21AC227:DBC59FCA9545A21B]:0)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:100)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.compareResults(AbstractFullDistribZkTestBase.java:1338)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.compareResults(AbstractFullDistribZkTestBase.java:1290)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:415)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:145)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.http.ParseException: Invalid content type:
at org.apache.http.entity.ContentType.parse(ContentType.java:233)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:443)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
... 46 more
Build Log:
[...truncated 10001 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
[junit4] 2> 3405 T10 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 3482 T10 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./solrtest-FullSolrCloudDistribCmdsTest-1393945103741
[junit4] 2> 3491 T10 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 3499 T11 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 3801 T10 oasc.ZkTestServer.run start zk server on port:48641
[junit4] 2> 4149 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 4203 T12 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 5882 T15 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63e3f789 name:ZooKeeperConnection Watcher:127.0.0.1:48641 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 5883 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 5888 T10 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 5998 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 6002 T19 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@315d13cd name:ZooKeeperConnection Watcher:127.0.0.1:48641/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 6002 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 6025 T10 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 6035 T10 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 6045 T10 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 6054 T10 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 6064 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 6151 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 6165 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 6167 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 6177 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 6178 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 6187 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 6188 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 6196 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 6197 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 6205 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 6206 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 6214 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 6215 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 6223 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 6224 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 6231 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 6232 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 6239 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 6240 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 6246 T10 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 6247 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 8997 T10 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 9501 T10 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:26811
[junit4] 2> 9938 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 9950 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 9951 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512
[junit4] 2> 9951 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512/'
[junit4] 2> 10789 T10 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512/solr.xml
[junit4] 2> 11228 T10 oasc.CoreContainer.<init> New CoreContainer 10285724
[junit4] 2> 11229 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512/]
[junit4] 2> 11447 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 11448 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 11460 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 11461 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 11462 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 11462 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 11463 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 11463 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 11464 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 12200 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 12205 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 12214 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 12215 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:48641/solr
[junit4] 2> 12251 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 12253 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 12258 T31 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33796a37 name:ZooKeeperConnection Watcher:127.0.0.1:48641 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 12259 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 12280 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 12282 T33 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ce20c1e name:ZooKeeperConnection Watcher:127.0.0.1:48641/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 12283 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 12299 T10 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 12314 T10 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 12341 T10 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 12344 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:26811_
[junit4] 2> 12353 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:26811_
[junit4] 2> 12359 T10 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 12363 T10 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 12390 T10 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:26811_
[junit4] 2> 12390 T10 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 12394 T10 oasc.Overseer.start Overseer (id=91353586356453379-127.0.0.1:26811_-n_0000000000) starting
[junit4] 2> 12429 T10 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 12546 T35 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 12546 T10 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 12566 T10 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 12569 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 12594 T35 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 12595 T34 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 13284 T36 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 13285 T36 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 13298 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 13298 T36 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 13305 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 13307 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:26811",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:26811_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 13308 T34 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 13342 T34 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 13348 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 13370 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 14300 T36 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 14301 T36 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512/collection1
[junit4] 2> 14301 T36 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 14303 T36 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 14303 T36 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 14305 T36 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 14306 T36 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512/collection1/'
[junit4] 2> 14309 T36 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512/collection1/lib/README' to classloader
[junit4] 2> 14310 T36 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512/collection1/lib/classes/' to classloader
[junit4] 2> 14311 T36 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512/collection1/lib/.svn/' to classloader
[junit4] 2> 14615 T36 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 14993 T36 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 15033 T36 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 15211 T36 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 15810 T36 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 15861 T36 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 15903 T36 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 15933 T36 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 17192 T36 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 17196 T36 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 17208 T36 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 17228 T36 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 18141 T36 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 18189 T36 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1393945106512/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/control/data/
[junit4] 2> 18198 T36 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@702ba9b0
[junit4] 2> 18465 T36 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/control/data
[junit4] 2> 18466 T36 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/control/data/index/
[junit4] 2> 18467 T36 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 18489 T36 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/control/data/index
[junit4] 2> 18491 T36 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=2.1201171875, floorSegmentMB=1.1826171875, forceMergeDeletesPctAllowed=8.721091180977767, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8919909701314453
[junit4] 2> 18742 T36 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2167c879 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50584ce6),segFN=segments_1,generation=1}
[junit4] 2> 18747 T36 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 20119 T36 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 20255 T36 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 20273 T36 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 20274 T36 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 20274 T36 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 20275 T36 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 20429 T36 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 20430 T36 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 20431 T36 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 20487 T36 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 20516 T36 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 20517 T36 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 20521 T36 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 20563 T36 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 20568 T36 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 20608 T36 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 20645 T36 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 20798 T36 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 20925 T36 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 20926 T36 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 20928 T36 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=3.8974609375, floorSegmentMB=1.3544921875, forceMergeDeletesPctAllowed=17.809582550231084, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5441787430492249
[junit4] 2> 20929 T36 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2167c879 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50584ce6),segFN=segments_1,generation=1}
[junit4] 2> 20930 T36 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 20978 T36 oass.SolrIndexSearcher.<init> Opening Searcher@5713ce9a[collection1] main
[junit4] 2> 21164 T37 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5713ce9a[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 21174 T36 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 21194 T10 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 21194 T40 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:26811 collection:control_collection shard:shard1
[junit4] 2> 21194 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 21242 T40 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 21263 T40 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 21273 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 21274 T40 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 21275 T40 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 21276 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 21290 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@10471047 url=http://127.0.0.1:26811/collection1 node=127.0.0.1:26811_ C0_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:26811, core=collection1, node_name=127.0.0.1:26811_}
[junit4] 2> 21295 T40 C0 P26811 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:26811/collection1/
[junit4] 2> 21298 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 21304 T40 C0 P26811 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 21305 T40 C0 P26811 oasc.SyncStrategy.syncToMe http://127.0.0.1:26811/collection1/ has no replicas
[junit4] 2> 21306 T40 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:26811/collection1/ shard1
[junit4] 2> 21325 T40 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 21337 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 21341 T42 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70f4a1d3 name:ZooKeeperConnection Watcher:127.0.0.1:48641/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21341 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 21342 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 21344 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 21345 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 21355 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 21355 T10 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 21459 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 21459 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 21499 T40 oasc.ZkController.register We are http://127.0.0.1:26811/collection1/ and leader is http://127.0.0.1:26811/collection1/
[junit4] 2> 21505 T40 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:26811
[junit4] 2> 21505 T40 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 21506 T40 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 21506 T40 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 21508 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 21509 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 21509 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 21509 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 21512 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 21513 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:26811",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:26811_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 21518 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 21622 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 21622 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 22440 T10 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 22441 T10 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 22444 T10 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:33888
[junit4] 2> 22445 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 22445 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 22446 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614
[junit4] 2> 22446 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614/'
[junit4] 2> 22477 T10 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614/solr.xml
[junit4] 2> 22575 T10 oasc.CoreContainer.<init> New CoreContainer 82525136
[junit4] 2> 22576 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614/]
[junit4] 2> 22578 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 22578 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 22579 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 22579 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 22580 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 22580 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 22581 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 22582 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 22582 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 22592 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 22593 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 22593 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 22594 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:48641/solr
[junit4] 2> 22594 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 22596 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 22600 T53 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fa3d735 name:ZooKeeperConnection Watcher:127.0.0.1:48641 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 22601 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 22618 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 22621 T55 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@197fb6e8 name:ZooKeeperConnection Watcher:127.0.0.1:48641/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 22621 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 22630 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 23636 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33888_
[junit4] 2> 23642 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33888_
[junit4] 2> 23647 T42 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 23647 T55 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 23647 T33 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 23663 T56 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 23664 T56 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 23667 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 23667 T56 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 23667 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 23668 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 23671 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 23672 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:33888",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33888_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 23673 T34 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 23673 T34 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 23678 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 23687 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 23687 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 23687 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 24669 T56 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 24670 T56 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614/collection1
[junit4] 2> 24670 T56 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 24672 T56 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 24672 T56 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 24674 T56 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 24675 T56 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614/collection1/'
[junit4] 2> 24678 T56 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614/collection1/lib/README' to classloader
[junit4] 2> 24679 T56 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614/collection1/lib/classes/' to classloader
[junit4] 2> 24681 T56 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614/collection1/lib/.svn/' to classloader
[junit4] 2> 24812 T56 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 24920 T56 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 24923 T56 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 25039 T56 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 25730 T56 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 25733 T56 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 25736 T56 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 25743 T56 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 25804 T56 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 25804 T56 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1393945121614/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty1/
[junit4] 2> 25805 T56 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@702ba9b0
[junit4] 2> 25807 T56 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty1
[junit4] 2> 25808 T56 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty1/index/
[junit4] 2> 25808 T56 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 25809 T56 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty1/index
[junit4] 2> 25809 T56 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=2.1201171875, floorSegmentMB=1.1826171875, forceMergeDeletesPctAllowed=8.721091180977767, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8919909701314453
[junit4] 2> 25811 T56 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7ec101b0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2351449c),segFN=segments_1,generation=1}
[junit4] 2> 25811 T56 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 25822 T56 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 25822 T56 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 25823 T56 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 25823 T56 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 25824 T56 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 25824 T56 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 25825 T56 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 25825 T56 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 25826 T56 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 25828 T56 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 25830 T56 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 25830 T56 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 25831 T56 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 25833 T56 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 25834 T56 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 25836 T56 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 25838 T56 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 25851 T56 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 25856 T56 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 25856 T56 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 25859 T56 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=3.8974609375, floorSegmentMB=1.3544921875, forceMergeDeletesPctAllowed=17.809582550231084, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5441787430492249
[junit4] 2> 25860 T56 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7ec101b0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2351449c),segFN=segments_1,generation=1}
[junit4] 2> 25860 T56 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 25861 T56 oass.SolrIndexSearcher.<init> Opening Searcher@12f4818[collection1] main
[junit4] 2> 25874 T57 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12f4818[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 25885 T56 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 25886 T10 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 25887 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 25886 T60 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33888 collection:collection1 shard:shard2
[junit4] 2> 25890 T60 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 25902 T60 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 25916 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25917 T60 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 25918 T60 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@19a743eb url=http://127.0.0.1:33888/collection1 node=127.0.0.1:33888_ C1_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:33888, core=collection1, node_name=127.0.0.1:33888_}
[junit4] 2> 25918 T60 C1 P33888 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33888/collection1/
[junit4] 2> 25918 T60 C1 P33888 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 25919 T60 C1 P33888 oasc.SyncStrategy.syncToMe http://127.0.0.1:33888/collection1/ has no replicas
[junit4] 2> 25919 T60 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33888/collection1/ shard2
[junit4] 2> 25919 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 25919 T60 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 25926 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25928 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25928 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25928 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25934 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 25940 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26045 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 26045 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 26045 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 26084 T60 oasc.ZkController.register We are http://127.0.0.1:33888/collection1/ and leader is http://127.0.0.1:33888/collection1/
[junit4] 2> 26084 T60 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33888
[junit4] 2> 26085 T60 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 26085 T60 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 26085 T60 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 26088 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26088 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26088 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26088 T60 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 26090 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 26092 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:33888",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33888_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 26097 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26203 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 26204 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 26204 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 26834 T10 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 26835 T10 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 26838 T10 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:10757
[junit4] 2> 26839 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 26839 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 26840 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146
[junit4] 2> 26840 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146/'
[junit4] 2> 26871 T10 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146/solr.xml
[junit4] 2> 26954 T10 oasc.CoreContainer.<init> New CoreContainer 424481815
[junit4] 2> 26954 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146/]
[junit4] 2> 26956 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 26956 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 26957 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 26957 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 26958 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 26958 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 26959 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 26959 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 26960 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 26969 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 26970 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 26970 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 26971 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:48641/solr
[junit4] 2> 26971 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 26973 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 26977 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1361fefb name:ZooKeeperConnection Watcher:127.0.0.1:48641 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 26978 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 26982 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 26984 T73 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28f1d4e2 name:ZooKeeperConnection Watcher:127.0.0.1:48641/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 26985 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 26998 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 28004 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:10757_
[junit4] 2> 28006 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:10757_
[junit4] 2> 28011 T55 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 28012 T42 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 28012 T73 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 28012 T33 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 28037 T74 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 28038 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 28040 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28041 T74 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 28041 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28042 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28044 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 28046 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:10757",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:10757_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 28047 T34 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 28047 T34 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 28052 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28061 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28061 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28061 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28061 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 29042 T74 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 29042 T74 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146/collection1
[junit4] 2> 29043 T74 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 29044 T74 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 29045 T74 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 29047 T74 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 29047 T74 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146/collection1/'
[junit4] 2> 29050 T74 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146/collection1/lib/classes/' to classloader
[junit4] 2> 29051 T74 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146/collection1/lib/README' to classloader
[junit4] 2> 29052 T74 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146/collection1/lib/.svn/' to classloader
[junit4] 2> 29168 T74 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 29257 T74 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 29260 T74 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 29359 T74 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 30105 T74 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 30109 T74 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 30113 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 30121 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 30196 T74 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 30197 T74 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1393945126146/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty2/
[junit4] 2> 30198 T74 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@702ba9b0
[junit4] 2> 30199 T74 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty2
[junit4] 2> 30200 T74 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty2/index/
[junit4] 2> 30200 T74 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 30201 T74 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1393945103741/jetty2/index
[junit4] 2> 30202 T74 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=2.1201171875, floorSegmentMB=1.1826171875, forceMergeDeletesPctAllowed=8.721091180977767, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8919909701314453
[junit4] 2> 30203 T74 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@12bced2b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@96382bc),segFN=segments_1,generation=1}
[junit4] 2> 30204 T74 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 30219 T74 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 30220 T74 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 30220 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 30221 T74 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 30222 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 30222 T74 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 30223 T74 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 30224 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 30224 T74 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 30227 T74 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 30230 T74 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 30230 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 30231 T74 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 30233 T74 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 30234 T74 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 30237 T74 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 30240 T74 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 30256 T74 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 30263 T74 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 30263 T74 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 30266 T74 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=3.8974609375, floorSegmentMB=1.3544921875, forceMergeDeletesPctAllowed=17.809582550231084, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5441787430492249
[junit4] 2> 30267 T74 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@12bced2b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@96382bc),segFN=segments_1,generation=1}
[junit4] 2> 30268 T74 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 30269 T74 oass.SolrIndexSearcher.<init> Opening Searcher@59d729a1[collection1] main
[junit4] 2> 30285 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59d729a1[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 30298 T74 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 30299 T10 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 30301 T78 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:10757 collection:collection1 shard:shard3
[junit4] 2> 30302 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 30305 T78 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 30337 T78 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 30342 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30343 T78 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 30343 T78 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@1404e91f url=http://127.0.0.1:10757/collection1 node=127.0.0.1:10757_ C2_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:10757, core=collection1, node_name=127.0.0.1:10757_}
[junit4] 2> 30344 T78 C2 P10757 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:10757/collection1/
[junit4] 2> 30345 T78 C2 P10757 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 30345 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 30345 T78 C2 P10757 oasc.SyncStrategy.syncToMe http://127.0.0.1:10757/collection1/ has no replicas
[junit4] 2> 30346 T78 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:10757/collection1/ shard3
[junit4] 2> 30347 T78 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 30352 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30360 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30361 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30361 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30361 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30369 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 30376 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30481 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30481 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30481 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30481 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30521 T78 oasc.ZkController.register We are http://127.0.0.1:10757/collection1/ and leader is http://127.0.0.1:10757/collection1/
[junit4] 2> 30521 T78 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:10757
[junit4] 2> 30522 T78 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 30522 T78 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 30522 T78 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 30525 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30525 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30526 T78 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 30526 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30529 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 30531 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:10757",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:10757_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 30536 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30642 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30642 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30642 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30642 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 31326 T10 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 31327 T10 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 31330 T10 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:38067
[junit4] 2> 31330 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 31331 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 31331 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1393945130562
[junit4] 2> 31332 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1393945130562/'
[junit4] 2> 31367 T10 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1393945130562/solr.xml
[junit4] 2> 31443 T10 oasc.CoreContainer.<init> New CoreContainer 1280156403
[junit4] 2> 31444 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1393945130562/]
[junit4] 2> 31445 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 31446 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 31446 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 31447 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 31447 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 31447 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 31448 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 31448 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 31449 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 31458 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 31459 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 31459 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 31460 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:48641/solr
[junit4] 2> 31460 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 31461 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 31464 T89 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d0526a7 name:ZooKeeperConnection Watcher:127.0.0.1:48641 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 31464 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 31467 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 31479 T91 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@434e25e1 name:ZooKeeperConnection Watcher:127.0.0.1:48641/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 31480 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 31488 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 32494 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38067_
[junit4] 2> 32496 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38067_
[junit4] 2> 32509 T55 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 32509 T91 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 32510 T33 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 32509 T73 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 32509 T42 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 32524 T92 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 32525 T92 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 32527 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 32527 T92 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 32528 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 32529 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 32530 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 32532 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38067",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38067_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 32532 T34 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 32533 T34 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 32538 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 32546 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 32547 T91 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 32547 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 32547 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 32547 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 33529 T92 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 33529 T92 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1393945130562/collection1
[junit4] 2> 33530 T92 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 33531 T92 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 33531 T92 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 33533 T92 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 33533 T92 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1393945130562/collection1/'
[junit4] 2> 33535 T92 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1393945130562/collection1/lib/README' to classloader
[junit4] 2> 33536 T92 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1393945130562/collection1/lib/.svn/' to classloader
[junit4] 2> 33537 T92 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1393945130562/collection1/lib/classes/' to classloader
[junit4] 2> 33600 T92 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 33665 T92 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 33668 T92 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 33718 T92 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 34222 T92 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 34225 T92 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 34228 T92 oass.FileExchangeRateProvider.relo
[...truncated too long message...]
alse), 7child6_s=MockFixedIntBlock(blockSize=1332), 14grand12_s=PostingsFormat(name=Lucene41WithOrds), 9parent_f1_s=PostingsFormat(name=Memory doPackFST= false), 13grand1_s=PostingsFormat(name=Memory doPackFST= false), 14grand2_s=MockFixedIntBlock(blockSize=1332), 15grand3_s=PostingsFormat(name=Memory doPackFST= false), 3child1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 7grand3_s=PostingsFormat(name=Lucene41WithOrds), 14grand1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 6child2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 14grand11_s=MockFixedIntBlock(blockSize=1332), 9parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 8grand3_s=PostingsFormat(name=Memory doPackFST= false), 6grand0_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 8child3_s=PostingsFormat(name=Memory doPackFST= false), _root_=PostingsFormat(name=Lucene41WithOrds), 3grand1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 12grand1_s=PostingsFormat(name=Lucene41WithOrds), 14grand9_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 15grand9_s=MockFixedIntBlock(blockSize=1332), 26parent_f1_s=PostingsFormat(name=Lucene41WithOrds), _version_=PostingsFormat(name=Lucene41WithOrds), 0parent_f2_s=MockFixedIntBlock(blockSize=1332), 6child0_s=PostingsFormat(name=Lucene41WithOrds), 11grand10_s=PostingsFormat(name=Memory doPackFST= false), 11grand6_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 6grand5_s=PostingsFormat(name=Memory doPackFST= false), type_s=PostingsFormat(name=Lucene41WithOrds), 33parent_f1_s=PostingsFormat(name=Lucene41WithOrds), 17parent_f2_s=PostingsFormat(name=Memory doPackFST= false), 13grand11_s=PostingsFormat(name=Lucene41WithOrds), 19parent_f2_s=MockFixedIntBlock(blockSize=1332), 12parent_f1_s=PostingsFormat(name=Memory doPackFST= false), 7parent_f2_s=PostingsFormat(name=Lucene41WithOrds), 9grand0_s=MockFixedIntBlock(blockSize=1332), 8child6_s=PostingsFormat(name=Lucene41WithOrds), 14grand10_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 5child2_s=PostingsFormat(name=Memory doPackFST= false), 11grand2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 0parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 10grand9_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 6child5_s=PostingsFormat(name=Memory doPackFST= false), 3grand2_s=MockFixedIntBlock(blockSize=1332), 22parent_f1_s=PostingsFormat(name=Lucene41WithOrds), 8grand5_s=MockFixedIntBlock(blockSize=1332), 10grand7_s=PostingsFormat(name=Lucene41WithOrds), 15grand11_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 38parent_f2_s=PostingsFormat(name=Lucene41WithOrds), 5grand4_s=MockFixedIntBlock(blockSize=1332), 8grand6_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 1child0_s=MockFixedIntBlock(blockSize=1332), a_t=PostingsFormat(name=Lucene41VarGapFixedInterval), 12grand6_s=PostingsFormat(name=Memory doPackFST= false), 10parent_f1_s=MockFixedIntBlock(blockSize=1332), 4child3_s=PostingsFormat(name=Memory doPackFST= false), 7parent_f1_s=MockFixedIntBlock(blockSize=1332), 7child2_s=MockFixedIntBlock(blockSize=1332), 4grand3_s=PostingsFormat(name=Memory doPackFST= false), 15grand0_s=PostingsFormat(name=Lucene41WithOrds), 9grand3_s=PostingsFormat(name=Lucene41WithOrds), 30parent_f1_s=PostingsFormat(name=Memory doPackFST= false), 25parent_f1_s=MockFixedIntBlock(blockSize=1332), 3child2_s=MockFixedIntBlock(blockSize=1332), 36parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 1parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 12grand4_s=MockFixedIntBlock(blockSize=1332), 18parent_f1_s=MockFixedIntBlock(blockSize=1332), 34parent_f2_s=PostingsFormat(name=Lucene41WithOrds), 10grand5_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 7grand5_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 2child0_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 8child1_s=MockFixedIntBlock(blockSize=1332), 37parent_f2_s=MockFixedIntBlock(blockSize=1332), 2grand1_s=PostingsFormat(name=Memory doPackFST= false), 32parent_f1_s=MockFixedIntBlock(blockSize=1332), 31parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 8grand4_s=PostingsFormat(name=Lucene41WithOrds), 12parent_f2_s=PostingsFormat(name=Lucene41WithOrds), 11grand7_s=PostingsFormat(name=Memory doPackFST= false), 35parent_f2_s=PostingsFormat(name=Memory doPackFST= false), 13parent_f2_s=PostingsFormat(name=Memory doPackFST= false), 7child0_s=PostingsFormat(name=Memory doPackFST= false), 16parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 6child3_s=MockFixedIntBlock(blockSize=1332), 5grand2_s=PostingsFormat(name=Memory doPackFST= false), 13parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 14grand0_s=PostingsFormat(name=Memory doPackFST= false), 12grand10_s=PostingsFormat(name=Lucene41WithOrds), 9grand6_s=PostingsFormat(name=Memory doPackFST= false), 15grand13_s=PostingsFormat(name=Lucene41WithOrds), 15grand1_s=MockFixedIntBlock(blockSize=1332), 7child3_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 27parent_f1_s=PostingsFormat(name=Memory doPackFST= false), 20parent_f2_s=PostingsFormat(name=Memory doPackFST= false), 14grand3_s=PostingsFormat(name=Lucene41WithOrds), 11grand4_s=PostingsFormat(name=Lucene41WithOrds), 9grand4_s=MockFixedIntBlock(blockSize=1332), 28parent_f1_s=PostingsFormat(name=Lucene41WithOrds), 14grand5_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 20parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 14parent_f2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 5child1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 11parent_f1_s=PostingsFormat(name=Lucene41WithOrds), 15grand2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 9grand8_s=MockFixedIntBlock(blockSize=1332), 12grand9_s=PostingsFormat(name=Lucene41WithOrds), 34parent_f1_s=PostingsFormat(name=Memory doPackFST= false), 2grand0_s=PostingsFormat(name=Lucene41WithOrds), 27parent_f2_s=PostingsFormat(name=Lucene41WithOrds), 6grand2_s=PostingsFormat(name=Lucene41WithOrds), 8grand7_s=PostingsFormat(name=Memory doPackFST= false), text_t=PostingsFormat(name=Lucene41WithOrds), 12grand2_s=PostingsFormat(name=Memory doPackFST= false), 8grand2_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 9grand1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 17parent_f1_s=PostingsFormat(name=Lucene41WithOrds), 9grand2_s=PostingsFormat(name=Memory doPackFST= false), 4grand1_s=MockFixedIntBlock(blockSize=1332), 7child1_s=PostingsFormat(name=Lucene41WithOrds), 6grand3_s=MockFixedIntBlock(blockSize=1332), 14grand8_s=PostingsFormat(name=Memory doPackFST= false), 6parent_f2_s=PostingsFormat(name=Memory doPackFST= false), 13grand2_s=PostingsFormat(name=Lucene41WithOrds), 5child3_s=PostingsFormat(name=Lucene41WithOrds), 4child0_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 30parent_f2_s=PostingsFormat(name=Lucene41WithOrds), 15grand5_s=MockFixedIntBlock(blockSize=1332), 12grand11_s=PostingsFormat(name=Memory doPackFST= false), 3grand0_s=PostingsFormat(name=Memory doPackFST= false), 13grand5_s=PostingsFormat(name=Memory doPackFST= false), 23parent_f2_s=PostingsFormat(name=Lucene41WithOrds), 24parent_f2_s=PostingsFormat(name=Memory doPackFST= false), 2parent_f1_s=PostingsFormat(name=Lucene41WithOrds), 14parent_f1_s=MockFixedIntBlock(blockSize=1332), 13grand9_s=PostingsFormat(name=Memory doPackFST= false), 7child5_s=PostingsFormat(name=Lucene41WithOrds), 5child4_s=MockFixedIntBlock(blockSize=1332), 13grand8_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 39parent_f1_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 15grand8_s=PostingsFormat(name=Lucene41WithOrds), 14grand7_s=PostingsFormat(name=Lucene41WithOrds), 8grand0_s=PostingsFormat(name=Lucene41WithOrds), 8child7_s=PostingsFormat(name=Memory doPackFST= false), 36parent_f1_s=MockFixedIntBlock(blockSize=1332), 4child2_s=PostingsFormat(name=Lucene41WithOrds), 7grand2_s=MockFixedIntBlock(blockSize=1332), 8child0_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 15grand6_s=PostingsFormat(name=Lucene41VarGapFixedInterval), 15grand10_s=PostingsFormat(name=Memory doPackFST= false), 4child1_s=MockFixedIntBlock(blockSize=1332), 13grand7_s=MockFixedIntBlock(blockSize=1332)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=in_ID, timezone=Europe/Tirane
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=155142368,total=428605440
[junit4] 2> NOTE: All tests run in this JVM: [FullSolrCloudDistribCmdsTest]
[junit4] Completed on J1 in 161.43s, 1 test, 1 error <<< FAILURES!
[...truncated 1134 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:472: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:445: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:490: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1274: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:907: There were test failures: 377 suites, 1615 tests, 1 error, 47 ignored (18 assumptions)
Total time: 135 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 533 - Still Failing
Posted by Michael McCandless <lu...@mikemccandless.com>.
This is hilarious.
I'll dig.
Mike McCandless
http://blog.mikemccandless.com
On Wed, Mar 5, 2014 at 4:18 PM, Apache Jenkins Server
<je...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/533/
>
> 3 tests failed.
> REGRESSION: org.apache.lucene.search.TestControlledRealTimeReopenThread.testControlledRealTimeReopenThread
>
> Error Message:
> Captured an uncaught exception in thread: Thread[id=4416, name=Thread-3630, state=RUNNABLE, group=TGRP-TestControlledRealTimeReopenThread]
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4416, name=Thread-3630, state=RUNNABLE, group=TGRP-TestControlledRealTimeReopenThread]
> Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
> at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
> at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:301)
> Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
> at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:192)
> at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:210)
> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:299)
> at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:415)
> at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1298)
> at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1259)
> at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1244)
> at org.apache.lucene.index.TrackingIndexWriter.addDocuments(TrackingIndexWriter.java:155)
> at org.apache.lucene.search.TestControlledRealTimeReopenThread.addDocuments(TestControlledRealTimeReopenThread.java:124)
> at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:217)
>
>
> FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestControlledRealTimeReopenThread
>
> Error Message:
> 3 threads leaked from SUITE scope at org.apache.lucene.search.TestControlledRealTimeReopenThread: 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2) Thread[id=4413, name=NRTDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223) 3) Thread[id=4414, name=NRTNoDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.lucene.search.TestControlledRealTimeReopenThread:
> 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread]
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
> 2) Thread[id=4413, name=NRTDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread]
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
> at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
> 3) Thread[id=4414, name=NRTNoDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread]
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
> at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
> at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
>
>
> FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestControlledRealTimeReopenThread
>
> Error Message:
> There are still zombie threads that couldn't be terminated: 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
> 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread]
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
> at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
>
>
>
>
> Build Log:
> [...truncated 1557 lines...]
> [junit4] Suite: org.apache.lucene.search.TestControlledRealTimeReopenThread
> [junit4] 1> Thread-3630: hit exc
> [junit4] 2> java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
> [junit4] 2> at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:192)
> [junit4] 2> at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:210)
> [junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:299)
> [junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:415)
> [junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1298)
> [junit4] 2> at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1259)
> [junit4] 2> at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1244)
> [junit4] 2> at org.apache.lucene.index.TrackingIndexWriter.addDocuments(TrackingIndexWriter.java:155)
> [junit4] 2> at org.apache.lucene.search.TestControlledRealTimeReopenThread.addDocuments(TestControlledRealTimeReopenThread.java:124)
> [junit4] 2> at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:217)
> [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestControlledRealTimeReopenThread -Dtests.method=testControlledRealTimeReopenThread -Dtests.seed=27F19163DF247083 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_SV -Dtests.timezone=Antarctica/Rothera -Dtests.file.encoding=US-ASCII
> [junit4] ERROR 300s J0 | TestControlledRealTimeReopenThread.testControlledRealTimeReopenThread <<<
> [junit4] > Throwable #1: java.lang.AssertionError
> [junit4] > at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.runTest(ThreadedIndexingAndSearchingTestCase.java:543)
> [junit4] > at org.apache.lucene.search.TestControlledRealTimeReopenThread.testControlledRealTimeReopenThread(TestControlledRealTimeReopenThread.java:72)
> [junit4] > at java.lang.Thread.run(Thread.java:724)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4416, name=Thread-3630, state=RUNNABLE, group=TGRP-TestControlledRealTimeReopenThread]
> [junit4] > Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
> [junit4] > at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
> [junit4] > at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:301)
> [junit4] > Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
> [junit4] > at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:192)
> [junit4] > at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:210)
> [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:299)
> [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:415)
> [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1298)
> [junit4] > at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1259)
> [junit4] > at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1244)
> [junit4] > at org.apache.lucene.index.TrackingIndexWriter.addDocuments(TrackingIndexWriter.java:155)
> [junit4] > at org.apache.lucene.search.TestControlledRealTimeReopenThread.addDocuments(TestControlledRealTimeReopenThread.java:124)
> [junit4] > at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:217)
> [junit4] 2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {extra26=DFR I(ne)L2, test=DFR I(ne)2, extra29=DFR I(n)B1, extra22=DFR GL1, body=DFR GB1, extra13=DFR I(ne)BZ(0.3), extra8=DFR I(ne)2, extra36=DFR I(n)2, extra25=DFR I(ne)3(800.0), extra19=DFR I(n)B3(800.0), extra7=DFR G2, extra17=DFR I(ne)Z(0.3), extra1=IB SPL-DZ(0.3), titleTokenized=DFR I(n)B2, extra39=DFR I(ne)BZ(0.3), extra27=IB LL-D2, extra12=IB LL-L1, extra5=IB SPL-L3(800.0), extra24=DefaultSimilarity, extra18=DFR GB3(800.0), extra16=DFR GBZ(0.3), extra21=DFR I(F)B2, extra35=DFR GZ(0.3), extra33=DFR I(ne)LZ(0.3), extra37=DFR I(n)L1, extra15=DFR I(ne)B2, extra14=IB LL-DZ(0.3), extra10=DFR I(n)BZ(0.3), extra4=IB LL-LZ(0.3), extra9=DFR I(n)1, extra38=IB LL-L1, extra2=IB SPL-L1, extra30=IB SPL-L3(800.0), extra11=DFR I(n)L1, extra34=DFR I(F)BZ(0.3), extra6=DFR I(F)1, extra20=DFR I(F)3(800.0), extra28=DFR I(F)2, extra0=DFR GB1, extra3=DFR I(n)3(800.0), extra31=DFR I(F)1, extra23=DFR I(ne)1, extra32=DFR G2}, locale=es_SV, timezone=Antarctica/Rothera
> [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=2,free=153824984,total=519700480
> [junit4] 2> NOTE: All tests run in this JVM: [TestCloseableThreadLocal, TestCharTermAttributeImpl, TestCompiledAutomaton, ThrowInUncaught, TestCrashCausesCorruptIndex, TestTermVectorsWriter, TestMultiTermQueryRewrites, Nested, TestDeterminizeLexicon, TestMaxTermFrequency, TestTopDocsMerge, TestPhrasePrefixQuery, TestSortRandom, TestBytesRef, TestLucene40PostingsFormat, TestIsCurrent, TestSpanFirstQuery, TestComplexExplanations, TestStressIndexing, TestStressIndexing2, TestMockCharFilter, TestSpecialOperations, TestNRTThreads, TestDocValuesWithThreads, TestSpanExplanationsOfNonMatches, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, TestPayloadTermQuery, Nested1, TestCompressingTermVectorsFormat, TestSearch, TestDirectoryReader, TestBytesRefHash, TestIndexWriterConfig, TestCustomSearcherSort, TestCrash, TestSearchAfter, TestNoDeletionPolicy, TestPersistentSnapshotDeletionPolicy, TestEliasFanoSequence, TestUniqueTermCount, TestSegmentTermDocs, TestLucene41StoredFieldsFormat, TestSearcherManager, TestArrayUtil, TestFieldCacheSanityChecker, TestFilteredQuery, TestDocumentsWriterDeleteQueue, TestScoreCachingWrappingScorer, TestBooleanMinShouldMatch, TestUTF32ToUTF8, InBeforeClass, InAfterClass, InTestMethod, NonStringProperties, TestIndexWriterForceMerge, TestSimilarity, TestIndexWriterLockRelease, TestLookaheadTokenFilter, TestPagedBytes, TestDocTermOrdsRewriteMethod, TestReusableStringReader, TestSimpleAttributeImpl, TestIndexSearcher, TestLock, TestDocIdSet, TestParallelTermEnum, TestSimpleExplanations, TestSetOnce, TestCachingCollector, TestWildcardRandom, TestExplanations, TestParallelReaderEmptyIndex, TestDocTermOrds, TestSearchForDuplicates, TestFilterIterator, Nested1, TestInPlaceMergeSorter, TestEliasFanoDocIdSet, TestLucene40PostingsReader, TestMockAnalyzer, TestSentinelIntSet, TestPayloadsOnVectors, TestMultiValuedNumericRangeQuery, TestCustomNorms, TestSpansAdvanced2, TestOfflineSorter, TestConstantScoreQuery, TestStressAdvance, TestDateTools, TestSpanMultiTermQueryWrapper, TestFilteredSearch, TestTopFieldCollector, TestDeterminism, TestSameScoresWithThreads, Test2BPostingsBytes, TestFieldsReader, TestIndexWriterCommit, TestTimeLimitingCollector, TestSearchWithThreads, TestHighCompressionMode, TestNeverDelete, TestCompoundFile, TestLongPostings, TestRollingUpdates, TestBlockPostingsFormat2, TestSnapshotDeletionPolicy, TestNRTReaderWithThreads, TestTieredMergePolicy, TestPerFieldPostingsFormat, TestByteSlices, TestTermsEnum, TestConsistentFieldNumbers, TestWeakIdentityMap, TestDocTermOrdsRangeFilter, TestLockFactory, TestSegmentMerger, TestPhraseQuery, TestCollectionUtil, TestBagOfPositions, TestTransactions, TestBlockPostingsFormat, TestPostingsFormat, TestSpans, TestPostingsOffsets, TestMixedCodecs, TestTransactionRollback, TestSpanExplanations, TestFastCompressionMode, TestRAMDirectory, TestMultiPhraseQuery, TestRamUsageEstimatorOnWildAnimals, TestMergeSchedulerExternal, TestFieldCacheRangeFilter, TestBagOfPostings, TestCodecs, TestPayloadExplanations, TestParallelAtomicReader, TestThreadedForceMerge, TestStressNRT, TestIndexInput, TestCopyBytes, TestDisjunctionMaxQuery, TestOmitTf, TestNearSpansOrdered, TestMultiFields, TestTermRangeQuery, TestDocumentWriter, TestScorerPerf, TestAutomatonQueryUnicode, TestFieldCacheTermsFilter, TestTotalHitCountCollector, TestRecyclingByteBlockAllocator, TestBooleanScorer, TestRamUsageEstimator, TestNoMergeScheduler, TestNamedSPILoader, TestByteBlockPool, TestDemo, TestRollback, TestFieldInfos, TestTwoPhaseCommitTool, TestIndexWriterOnJRECrash, TestPrefixFilter, TestVersion, Test4GBStoredFields, TestCodecHoldsOpenFiles, TestReaderClosed, MultiCollectorTest, TestDocBoost, TestNGramPhraseQuery, Nested1, Test2BPositions, TestIndexCommit, TestTerm, TestPositiveScoresOnlyCollector, TestTopScoreDocCollector, TestIOUtils, Test2BTerms, TestLucene40StoredFieldsFormat, TestLucene45DocValuesFormat, TestExceedMaxTermLength, TestIndexWriterOutOfFileDescriptors, TestLogMergePolicy, TestNumericDocValuesUpdates, TestTryDelete, TestControlledRealTimeReopenThread]
> [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestControlledRealTimeReopenThread -Dtests.seed=27F19163DF247083 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_SV -Dtests.timezone=Antarctica/Rothera -Dtests.file.encoding=US-ASCII
> [junit4] ERROR 0.00s J0 | TestControlledRealTimeReopenThread (suite) <<<
> [junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.lucene.search.TestControlledRealTimeReopenThread:
> [junit4] > 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread]
> [junit4] > at sun.misc.Unsafe.park(Native Method)
> [junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
> [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
> [junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
> [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
> [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [junit4] > at java.lang.Thread.run(Thread.java:724)
> [junit4] > 2) Thread[id=4413, name=NRTDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread]
> [junit4] > at sun.misc.Unsafe.park(Native Method)
> [junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
> [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
> [junit4] > at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
> [junit4] > 3) Thread[id=4414, name=NRTNoDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread]
> [junit4] > at sun.misc.Unsafe.park(Native Method)
> [junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
> [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
> [junit4] > at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
> [junit4] > at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
> [junit4] > 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread]
> [junit4] > at sun.misc.Unsafe.park(Native Method)
> [junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
> [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
> [junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> [junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
> [junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
> [junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [junit4] > at java.lang.Thread.run(Thread.java:724)
> [junit4] > at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
> [junit4] Completed on J0 in 332.24s, 5 tests, 3 errors <<< FAILURES!
>
> [...truncated 11 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:472: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:445: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:37: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:49: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1274: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:907: There were test failures: 378 suites, 2740 tests, 2 suite-level errors, 1 error, 67 ignored (54 assumptions)
>
> Total time: 43 minutes 38 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 533 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/533/
3 tests failed.
REGRESSION: org.apache.lucene.search.TestControlledRealTimeReopenThread.testControlledRealTimeReopenThread
Error Message:
Captured an uncaught exception in thread: Thread[id=4416, name=Thread-3630, state=RUNNABLE, group=TGRP-TestControlledRealTimeReopenThread]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4416, name=Thread-3630, state=RUNNABLE, group=TGRP-TestControlledRealTimeReopenThread]
Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:301)
Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:192)
at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:210)
at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:299)
at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:415)
at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1298)
at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1259)
at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1244)
at org.apache.lucene.index.TrackingIndexWriter.addDocuments(TrackingIndexWriter.java:155)
at org.apache.lucene.search.TestControlledRealTimeReopenThread.addDocuments(TestControlledRealTimeReopenThread.java:124)
at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:217)
FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestControlledRealTimeReopenThread
Error Message:
3 threads leaked from SUITE scope at org.apache.lucene.search.TestControlledRealTimeReopenThread: 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) 2) Thread[id=4413, name=NRTDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223) 3) Thread[id=4414, name=NRTNoDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.lucene.search.TestControlledRealTimeReopenThread:
1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2) Thread[id=4413, name=NRTDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
3) Thread[id=4414, name=NRTNoDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestControlledRealTimeReopenThread
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
Build Log:
[...truncated 1557 lines...]
[junit4] Suite: org.apache.lucene.search.TestControlledRealTimeReopenThread
[junit4] 1> Thread-3630: hit exc
[junit4] 2> java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
[junit4] 2> at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:192)
[junit4] 2> at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:210)
[junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:299)
[junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:415)
[junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1298)
[junit4] 2> at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1259)
[junit4] 2> at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1244)
[junit4] 2> at org.apache.lucene.index.TrackingIndexWriter.addDocuments(TrackingIndexWriter.java:155)
[junit4] 2> at org.apache.lucene.search.TestControlledRealTimeReopenThread.addDocuments(TestControlledRealTimeReopenThread.java:124)
[junit4] 2> at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:217)
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestControlledRealTimeReopenThread -Dtests.method=testControlledRealTimeReopenThread -Dtests.seed=27F19163DF247083 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_SV -Dtests.timezone=Antarctica/Rothera -Dtests.file.encoding=US-ASCII
[junit4] ERROR 300s J0 | TestControlledRealTimeReopenThread.testControlledRealTimeReopenThread <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.runTest(ThreadedIndexingAndSearchingTestCase.java:543)
[junit4] > at org.apache.lucene.search.TestControlledRealTimeReopenThread.testControlledRealTimeReopenThread(TestControlledRealTimeReopenThread.java:72)
[junit4] > at java.lang.Thread.run(Thread.java:724)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4416, name=Thread-3630, state=RUNNABLE, group=TGRP-TestControlledRealTimeReopenThread]
[junit4] > Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
[junit4] > at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
[junit4] > at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:301)
[junit4] > Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[7d 7d 7b 7b 7b 7b 7b 73 75 62 73 74 63 7c 7d 7d 7d 7b 7b 7b 31 7d 7d 7d 7c 7b 7b 7b 70 31]...'
[junit4] > at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:192)
[junit4] > at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:210)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:299)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:415)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1298)
[junit4] > at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1259)
[junit4] > at org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1244)
[junit4] > at org.apache.lucene.index.TrackingIndexWriter.addDocuments(TrackingIndexWriter.java:155)
[junit4] > at org.apache.lucene.search.TestControlledRealTimeReopenThread.addDocuments(TestControlledRealTimeReopenThread.java:124)
[junit4] > at org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:217)
[junit4] 2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {extra26=DFR I(ne)L2, test=DFR I(ne)2, extra29=DFR I(n)B1, extra22=DFR GL1, body=DFR GB1, extra13=DFR I(ne)BZ(0.3), extra8=DFR I(ne)2, extra36=DFR I(n)2, extra25=DFR I(ne)3(800.0), extra19=DFR I(n)B3(800.0), extra7=DFR G2, extra17=DFR I(ne)Z(0.3), extra1=IB SPL-DZ(0.3), titleTokenized=DFR I(n)B2, extra39=DFR I(ne)BZ(0.3), extra27=IB LL-D2, extra12=IB LL-L1, extra5=IB SPL-L3(800.0), extra24=DefaultSimilarity, extra18=DFR GB3(800.0), extra16=DFR GBZ(0.3), extra21=DFR I(F)B2, extra35=DFR GZ(0.3), extra33=DFR I(ne)LZ(0.3), extra37=DFR I(n)L1, extra15=DFR I(ne)B2, extra14=IB LL-DZ(0.3), extra10=DFR I(n)BZ(0.3), extra4=IB LL-LZ(0.3), extra9=DFR I(n)1, extra38=IB LL-L1, extra2=IB SPL-L1, extra30=IB SPL-L3(800.0), extra11=DFR I(n)L1, extra34=DFR I(F)BZ(0.3), extra6=DFR I(F)1, extra20=DFR I(F)3(800.0), extra28=DFR I(F)2, extra0=DFR GB1, extra3=DFR I(n)3(800.0), extra31=DFR I(F)1, extra23=DFR I(ne)1, extra32=DFR G2}, locale=es_SV, timezone=Antarctica/Rothera
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=2,free=153824984,total=519700480
[junit4] 2> NOTE: All tests run in this JVM: [TestCloseableThreadLocal, TestCharTermAttributeImpl, TestCompiledAutomaton, ThrowInUncaught, TestCrashCausesCorruptIndex, TestTermVectorsWriter, TestMultiTermQueryRewrites, Nested, TestDeterminizeLexicon, TestMaxTermFrequency, TestTopDocsMerge, TestPhrasePrefixQuery, TestSortRandom, TestBytesRef, TestLucene40PostingsFormat, TestIsCurrent, TestSpanFirstQuery, TestComplexExplanations, TestStressIndexing, TestStressIndexing2, TestMockCharFilter, TestSpecialOperations, TestNRTThreads, TestDocValuesWithThreads, TestSpanExplanationsOfNonMatches, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, TestPayloadTermQuery, Nested1, TestCompressingTermVectorsFormat, TestSearch, TestDirectoryReader, TestBytesRefHash, TestIndexWriterConfig, TestCustomSearcherSort, TestCrash, TestSearchAfter, TestNoDeletionPolicy, TestPersistentSnapshotDeletionPolicy, TestEliasFanoSequence, TestUniqueTermCount, TestSegmentTermDocs, TestLucene41StoredFieldsFormat, TestSearcherManager, TestArrayUtil, TestFieldCacheSanityChecker, TestFilteredQuery, TestDocumentsWriterDeleteQueue, TestScoreCachingWrappingScorer, TestBooleanMinShouldMatch, TestUTF32ToUTF8, InBeforeClass, InAfterClass, InTestMethod, NonStringProperties, TestIndexWriterForceMerge, TestSimilarity, TestIndexWriterLockRelease, TestLookaheadTokenFilter, TestPagedBytes, TestDocTermOrdsRewriteMethod, TestReusableStringReader, TestSimpleAttributeImpl, TestIndexSearcher, TestLock, TestDocIdSet, TestParallelTermEnum, TestSimpleExplanations, TestSetOnce, TestCachingCollector, TestWildcardRandom, TestExplanations, TestParallelReaderEmptyIndex, TestDocTermOrds, TestSearchForDuplicates, TestFilterIterator, Nested1, TestInPlaceMergeSorter, TestEliasFanoDocIdSet, TestLucene40PostingsReader, TestMockAnalyzer, TestSentinelIntSet, TestPayloadsOnVectors, TestMultiValuedNumericRangeQuery, TestCustomNorms, TestSpansAdvanced2, TestOfflineSorter, TestConstantScoreQuery, TestStressAdvance, TestDateTools, TestSpanMultiTermQueryWrapper, TestFilteredSearch, TestTopFieldCollector, TestDeterminism, TestSameScoresWithThreads, Test2BPostingsBytes, TestFieldsReader, TestIndexWriterCommit, TestTimeLimitingCollector, TestSearchWithThreads, TestHighCompressionMode, TestNeverDelete, TestCompoundFile, TestLongPostings, TestRollingUpdates, TestBlockPostingsFormat2, TestSnapshotDeletionPolicy, TestNRTReaderWithThreads, TestTieredMergePolicy, TestPerFieldPostingsFormat, TestByteSlices, TestTermsEnum, TestConsistentFieldNumbers, TestWeakIdentityMap, TestDocTermOrdsRangeFilter, TestLockFactory, TestSegmentMerger, TestPhraseQuery, TestCollectionUtil, TestBagOfPositions, TestTransactions, TestBlockPostingsFormat, TestPostingsFormat, TestSpans, TestPostingsOffsets, TestMixedCodecs, TestTransactionRollback, TestSpanExplanations, TestFastCompressionMode, TestRAMDirectory, TestMultiPhraseQuery, TestRamUsageEstimatorOnWildAnimals, TestMergeSchedulerExternal, TestFieldCacheRangeFilter, TestBagOfPostings, TestCodecs, TestPayloadExplanations, TestParallelAtomicReader, TestThreadedForceMerge, TestStressNRT, TestIndexInput, TestCopyBytes, TestDisjunctionMaxQuery, TestOmitTf, TestNearSpansOrdered, TestMultiFields, TestTermRangeQuery, TestDocumentWriter, TestScorerPerf, TestAutomatonQueryUnicode, TestFieldCacheTermsFilter, TestTotalHitCountCollector, TestRecyclingByteBlockAllocator, TestBooleanScorer, TestRamUsageEstimator, TestNoMergeScheduler, TestNamedSPILoader, TestByteBlockPool, TestDemo, TestRollback, TestFieldInfos, TestTwoPhaseCommitTool, TestIndexWriterOnJRECrash, TestPrefixFilter, TestVersion, Test4GBStoredFields, TestCodecHoldsOpenFiles, TestReaderClosed, MultiCollectorTest, TestDocBoost, TestNGramPhraseQuery, Nested1, Test2BPositions, TestIndexCommit, TestTerm, TestPositiveScoresOnlyCollector, TestTopScoreDocCollector, TestIOUtils, Test2BTerms, TestLucene40StoredFieldsFormat, TestLucene45DocValuesFormat, TestExceedMaxTermLength, TestIndexWriterOutOfFileDescriptors, TestLogMergePolicy, TestNumericDocValuesUpdates, TestTryDelete, TestControlledRealTimeReopenThread]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestControlledRealTimeReopenThread -Dtests.seed=27F19163DF247083 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_SV -Dtests.timezone=Antarctica/Rothera -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J0 | TestControlledRealTimeReopenThread (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.lucene.search.TestControlledRealTimeReopenThread:
[junit4] > 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] > 2) Thread[id=4413, name=NRTDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
[junit4] > at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
[junit4] > 3) Thread[id=4414, name=NRTNoDeletes Reopen Thread, state=TIMED_WAITING, group=TGRP-TestControlledRealTimeReopenThread]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
[junit4] > at org.apache.lucene.search.ControlledRealTimeReopenThread.run(ControlledRealTimeReopenThread.java:223)
[junit4] > at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=4664, name=LuceneTestCase-3194-thread-1, state=WAITING, group=TGRP-TestControlledRealTimeReopenThread]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] > at __randomizedtesting.SeedInfo.seed([27F19163DF247083]:0)
[junit4] Completed on J0 in 332.24s, 5 tests, 3 errors <<< FAILURES!
[...truncated 11 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:472: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:445: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:49: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1274: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:907: There were test failures: 378 suites, 2740 tests, 2 suite-level errors, 1 error, 67 ignored (54 assumptions)
Total time: 43 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure