You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/07/08 12:00:27 UTC
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4766 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4766/
1 tests failed.
REGRESSION: org.apache.solr.cloud.HttpPartitionTest.testDistribSearch
Error Message:
No registered leader was found after waiting for 60000ms , collection: c8n_1x3_lf slice: shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 60000ms , collection: c8n_1x3_lf slice: shard1
at __randomizedtesting.SeedInfo.seed([9E1A0B8C7271ED55:1FFC8594052E8D69]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:567)
at org.apache.solr.cloud.HttpPartitionTest.testRf3WithLeaderFailover(HttpPartitionTest.java:349)
at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:148)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12248 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/init-core-data-001
[junit4] 2> 2055023 T8261 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /aa/cd
[junit4] 2> 2055027 T8261 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 2055027 T8261 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2055028 T8262 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2055128 T8261 oasc.ZkTestServer.run start zk server on port:20510
[junit4] 2> 2055129 T8261 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2055132 T8268 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23308b51 name:ZooKeeperConnection Watcher:127.0.0.1:20510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055132 T8261 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2055133 T8261 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2055135 T8261 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2055136 T8270 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@236cba45 name:ZooKeeperConnection Watcher:127.0.0.1:20510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055137 T8261 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2055137 T8261 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2055139 T8261 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2055140 T8261 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2055141 T8261 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2055143 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2055143 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2055146 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2055146 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2055248 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2055248 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2055250 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2055251 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2055253 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2055253 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2055255 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2055255 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2055257 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2055258 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2055260 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2055260 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2055262 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2055262 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2055264 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2055265 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2055266 T8261 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2055267 T8261 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2056310 T8261 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2056313 T8261 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55890
[junit4] 2> 2056314 T8261 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2056314 T8261 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2056314 T8261 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-002
[junit4] 2> 2056315 T8261 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-002/'
[junit4] 2> 2056345 T8261 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-002/solr.xml
[junit4] 2> 2056399 T8261 oasc.CoreContainer.<init> New CoreContainer 621484863
[junit4] 2> 2056399 T8261 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-002/]
[junit4] 2> 2056400 T8261 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2056400 T8261 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2056401 T8261 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2056401 T8261 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2056401 T8261 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2056401 T8261 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2056402 T8261 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2056402 T8261 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2056402 T8261 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2056428 T8261 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2056428 T8261 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2056429 T8261 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2056429 T8261 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:20510/solr
[junit4] 2> 2056429 T8261 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2056430 T8261 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2056433 T8281 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@196257e3 name:ZooKeeperConnection Watcher:127.0.0.1:20510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2056433 T8261 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2056435 T8261 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2056436 T8283 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b7e7f97 name:ZooKeeperConnection Watcher:127.0.0.1:20510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2056436 T8261 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2056437 T8261 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2056439 T8261 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2056441 T8261 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2056444 T8261 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2056446 T8261 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2056448 T8261 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2056449 T8261 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11796_aa%2Fcd
[junit4] 2> 2056450 T8261 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11796_aa%2Fcd
[junit4] 2> 2056452 T8261 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2056453 T8261 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2056456 T8261 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:11796_aa%2Fcd
[junit4] 2> 2056456 T8261 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2056457 T8261 oasc.Overseer.start Overseer (id=92065794467758083-127.0.0.1:11796_aa%2Fcd-n_0000000000) starting
[junit4] 2> 2056459 T8261 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2056466 T8285 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2056466 T8261 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2056468 T8261 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2056469 T8261 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2056471 T8284 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2056475 T8286 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 2056475 T8286 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2056476 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2056476 T8286 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2056477 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2056477 T8284 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:11796/aa/cd",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:11796_aa%2Fcd",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2056477 T8284 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 2056478 T8284 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2056479 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2056480 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2057476 T8286 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2057477 T8286 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2057478 T8286 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2057478 T8286 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2057479 T8286 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2057479 T8286 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-002/collection1/'
[junit4] 2> 2057481 T8286 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 2057481 T8286 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 2057482 T8286 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 2057547 T8286 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 2057596 T8286 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2057697 T8286 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2057708 T8286 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2058141 T8286 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2058155 T8286 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2058158 T8286 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2058170 T8286 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2058175 T8286 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2058179 T8286 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2058180 T8286 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2058181 T8286 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2058181 T8286 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2058182 T8286 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2058182 T8286 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2058182 T8286 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2058183 T8286 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2058183 T8286 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-002/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/control/data/
[junit4] 2> 2058183 T8286 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5380477a
[junit4] 2> 2058184 T8286 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/control/data
[junit4] 2> 2058185 T8286 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/control/data/index/
[junit4] 2> 2058185 T8286 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 2058185 T8286 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/control/data/index
[junit4] 2> 2058186 T8286 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2058187 T8286 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@16f4b7b4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@43e12239),segFN=segments_1,generation=1}
[junit4] 2> 2058187 T8286 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2058192 T8286 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2058192 T8286 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2058192 T8286 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2058193 T8286 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2058193 T8286 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2058193 T8286 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2058194 T8286 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2058194 T8286 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2058195 T8286 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2058195 T8286 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2058196 T8286 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2058196 T8286 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2058196 T8286 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2058197 T8286 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2058197 T8286 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2058198 T8286 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2058198 T8286 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2058217 T8286 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2058224 T8286 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2058224 T8286 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2058224 T8286 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=11.59375, floorSegmentMB=1.44140625, forceMergeDeletesPctAllowed=20.855337104972982, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2058225 T8286 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@16f4b7b4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@43e12239),segFN=segments_1,generation=1}
[junit4] 2> 2058225 T8286 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2058226 T8286 oass.SolrIndexSearcher.<init> Opening Searcher@57ff6716[collection1] main
[junit4] 2> 2058226 T8286 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2058227 T8286 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2058227 T8286 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2058228 T8286 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2058228 T8286 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2058228 T8286 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2058229 T8286 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2058229 T8286 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2058230 T8286 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 2058232 T8286 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 2058232 T8286 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2058232 T8286 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2058235 T8287 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@57ff6716[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 2058238 T8286 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2058239 T8290 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:11796/aa/cd collection:control_collection shard:shard1
[junit4] 2> 2058240 T8261 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 2058240 T8261 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2058240 T8290 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2058245 T8261 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2058245 T8290 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2058246 T8293 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@498a52e7 name:ZooKeeperConnection Watcher:127.0.0.1:20510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2058246 T8261 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2058247 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2058247 T8290 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2058247 T8261 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2058248 T8290 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C982 name=collection1 org.apache.solr.core.SolrCore@6145b4c4 url=http://127.0.0.1:11796/aa/cd/collection1 node=127.0.0.1:11796_aa%2Fcd C982_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:11796/aa/cd, core=collection1, node_name=127.0.0.1:11796_aa%2Fcd}
[junit4] 2> 2058248 T8290 C982 P11796 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:11796/aa/cd/collection1/
[junit4] 2> 2058248 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2058249 T8290 C982 P11796 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2058249 T8290 C982 P11796 oasc.SyncStrategy.syncToMe http://127.0.0.1:11796/aa/cd/collection1/ has no replicas
[junit4] 2> 2058249 T8290 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:11796/aa/cd/collection1/ shard1
[junit4] 2> 2058250 T8290 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2058250 T8261 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2058251 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2058251 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2058251 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2058255 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2058257 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2058358 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2058358 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2058407 T8290 oasc.ZkController.register We are http://127.0.0.1:11796/aa/cd/collection1/ and leader is http://127.0.0.1:11796/aa/cd/collection1/
[junit4] 2> 2058408 T8290 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:11796/aa/cd
[junit4] 2> 2058408 T8290 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2058408 T8290 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 2058408 T8290 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2058410 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2058410 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2058410 T8290 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2058410 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2058411 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2058411 T8284 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:11796/aa/cd",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:11796_aa%2Fcd",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 2058413 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2058515 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2058515 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2059329 T8261 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 2059329 T8261 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2059332 T8261 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25261
[junit4] 2> 2059333 T8261 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2059333 T8261 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2059333 T8261 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-003
[junit4] 2> 2059334 T8261 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-003/'
[junit4] 2> 2059364 T8261 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-003/solr.xml
[junit4] 2> 2059418 T8261 oasc.CoreContainer.<init> New CoreContainer 1012530556
[junit4] 2> 2059419 T8261 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-003/]
[junit4] 2> 2059420 T8261 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2059420 T8261 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2059420 T8261 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2059420 T8261 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2059421 T8261 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2059421 T8261 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2059421 T8261 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2059421 T8261 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2059422 T8261 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2059422 T8261 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2059422 T8261 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2059423 T8261 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2059423 T8261 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:20510/solr
[junit4] 2> 2059423 T8261 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2059424 T8261 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2059425 T8304 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3810f6d8 name:ZooKeeperConnection Watcher:127.0.0.1:20510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2059426 T8261 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2059428 T8261 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2059429 T8306 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ee02d49 name:ZooKeeperConnection Watcher:127.0.0.1:20510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2059429 T8261 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2059433 T8261 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2060436 T8261 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51322_aa%2Fcd
[junit4] 2> 2060437 T8261 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51322_aa%2Fcd
[junit4] 2> 2060447 T8307 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2060448 T8307 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2060449 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2060449 T8307 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2060449 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2060449 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2060450 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2060451 T8284 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51322/aa/cd",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51322_aa%2Fcd",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2060451 T8284 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 2060451 T8284 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2060453 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2060454 T8306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2060454 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2060454 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2061449 T8307 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2061450 T8307 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2061451 T8307 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2061451 T8307 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2061452 T8307 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2061452 T8307 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-003/collection1/'
[junit4] 2> 2061454 T8307 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 2061454 T8307 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 2061455 T8307 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 2061520 T8307 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 2061586 T8307 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2061687 T8307 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2061698 T8307 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2062107 T8307 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2062120 T8307 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2062123 T8307 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2062135 T8307 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2062140 T8307 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2062144 T8307 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2062145 T8307 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2062146 T8307 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2062146 T8307 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2062147 T8307 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2062147 T8307 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2062148 T8307 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2062148 T8307 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2062148 T8307 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-003/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty1/
[junit4] 2> 2062149 T8307 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5380477a
[junit4] 2> 2062150 T8307 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty1
[junit4] 2> 2062150 T8307 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty1/index/
[junit4] 2> 2062150 T8307 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 2062151 T8307 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty1/index
[junit4] 2> 2062151 T8307 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2062152 T8307 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3b45fe55 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@20c23ee9),segFN=segments_1,generation=1}
[junit4] 2> 2062152 T8307 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2062158 T8307 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2062158 T8307 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2062158 T8307 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2062159 T8307 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2062159 T8307 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2062159 T8307 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2062160 T8307 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2062160 T8307 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2062160 T8307 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2062161 T8307 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2062162 T8307 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2062162 T8307 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2062162 T8307 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2062163 T8307 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2062163 T8307 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2062164 T8307 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2062165 T8307 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2062184 T8307 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2062188 T8307 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2062189 T8307 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2062190 T8307 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=11.59375, floorSegmentMB=1.44140625, forceMergeDeletesPctAllowed=20.855337104972982, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2062190 T8307 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3b45fe55 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@20c23ee9),segFN=segments_1,generation=1}
[junit4] 2> 2062191 T8307 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2062191 T8307 oass.SolrIndexSearcher.<init> Opening Searcher@3a1b4051[collection1] main
[junit4] 2> 2062191 T8307 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2062192 T8307 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2062192 T8307 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2062193 T8307 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2062193 T8307 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2062193 T8307 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2062194 T8307 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2062195 T8307 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2062195 T8307 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2062195 T8307 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2062200 T8308 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a1b4051[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 2062203 T8307 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2062204 T8311 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51322/aa/cd collection:collection1 shard:shard1
[junit4] 2> 2062204 T8261 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 2062205 T8261 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2062205 T8311 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2062210 T8311 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2062211 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2062212 T8311 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2062212 T8311 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C983 name=collection1 org.apache.solr.core.SolrCore@3a65d433 url=http://127.0.0.1:51322/aa/cd/collection1 node=127.0.0.1:51322_aa%2Fcd C983_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:51322/aa/cd, core=collection1, node_name=127.0.0.1:51322_aa%2Fcd}
[junit4] 2> 2062212 T8311 C983 P51322 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51322/aa/cd/collection1/
[junit4] 2> 2062212 T8311 C983 P51322 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2062213 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2062213 T8311 C983 P51322 oasc.SyncStrategy.syncToMe http://127.0.0.1:51322/aa/cd/collection1/ has no replicas
[junit4] 2> 2062213 T8311 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51322/aa/cd/collection1/ shard1
[junit4] 2> 2062213 T8311 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2062215 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2062216 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2062216 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2062216 T8306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2062219 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2062221 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2062322 T8306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2062322 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2062322 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2062371 T8311 oasc.ZkController.register We are http://127.0.0.1:51322/aa/cd/collection1/ and leader is http://127.0.0.1:51322/aa/cd/collection1/
[junit4] 2> 2062372 T8311 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51322/aa/cd
[junit4] 2> 2062372 T8311 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2062372 T8311 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2062372 T8311 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2062373 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2062374 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2062374 T8311 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2062374 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2062376 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2062376 T8284 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:51322/aa/cd",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51322_aa%2Fcd",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 2062378 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2062480 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2062480 T8306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2062480 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2063291 T8261 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 2063292 T8261 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2063294 T8261 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:21654
[junit4] 2> 2063295 T8261 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2063295 T8261 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2063295 T8261 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004
[junit4] 2> 2063295 T8261 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004/'
[junit4] 2> 2063326 T8261 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004/solr.xml
[junit4] 2> 2063399 T8261 oasc.CoreContainer.<init> New CoreContainer 869239620
[junit4] 2> 2063400 T8261 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004/]
[junit4] 2> 2063401 T8261 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2063401 T8261 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2063401 T8261 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2063401 T8261 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2063402 T8261 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2063402 T8261 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2063402 T8261 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2063402 T8261 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2063403 T8261 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2063403 T8261 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2063403 T8261 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2063404 T8261 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2063404 T8261 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:20510/solr
[junit4] 2> 2063404 T8261 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2063405 T8261 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2063406 T8323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ec037ee name:ZooKeeperConnection Watcher:127.0.0.1:20510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2063407 T8261 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2063408 T8261 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2063409 T8325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57974a95 name:ZooKeeperConnection Watcher:127.0.0.1:20510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2063410 T8261 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2063414 T8261 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2064416 T8261 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59953_aa%2Fcd
[junit4] 2> 2064417 T8261 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59953_aa%2Fcd
[junit4] 2> 2064427 T8326 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2064428 T8326 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2064429 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2064429 T8326 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2064429 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2064429 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2064431 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2064431 T8284 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59953/aa/cd",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59953_aa%2Fcd",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2064432 T8284 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 2064432 T8284 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2064433 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2064434 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2064434 T8306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2064434 T8325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2064434 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2065429 T8326 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2065430 T8326 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2065431 T8326 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2065431 T8326 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2065432 T8326 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2065432 T8326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004/collection1/'
[junit4] 2> 2065434 T8326 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 2065434 T8326 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 2065435 T8326 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 2065500 T8326 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 2065548 T8326 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2065649 T8326 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2065660 T8326 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2066078 T8326 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2066104 T8326 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2066107 T8326 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2066119 T8326 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2066124 T8326 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2066128 T8326 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2066129 T8326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2066129 T8326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2066129 T8326 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2066130 T8326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2066131 T8326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2066131 T8326 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2066131 T8326 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2066132 T8326 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty2/
[junit4] 2> 2066132 T8326 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5380477a
[junit4] 2> 2066133 T8326 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty2
[junit4] 2> 2066133 T8326 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty2/index/
[junit4] 2> 2066134 T8326 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 2066134 T8326 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-001/jetty2/index
[junit4] 2> 2066134 T8326 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2066135 T8326 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7355c39e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5038cc01),segFN=segments_1,generation=1}
[junit4] 2> 2066136 T8326 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2066141 T8326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2066141 T8326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2066142 T8326 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2066142 T8326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2066142 T8326 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2066143 T8326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2066143 T8326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2066143 T8326 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2066144 T8326 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2066144 T8326 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2066145 T8326 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2066145 T8326 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2066146 T8326 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2066146 T8326 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2066147 T8326 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2066147 T8326 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2066148 T8326 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2066166 T8326 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2066171 T8326 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2066172 T8326 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2066172 T8326 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=11.59375, floorSegmentMB=1.44140625, forceMergeDeletesPctAllowed=20.855337104972982, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 2066173 T8326 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7355c39e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5038cc01),segFN=segments_1,generation=1}
[junit4] 2> 2066173 T8326 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2066174 T8326 oass.SolrIndexSearcher.<init> Opening Searcher@58f304b4[collection1] main
[junit4] 2> 2066174 T8326 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2066175 T8326 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2066175 T8326 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2066176 T8326 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2066176 T8326 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2066176 T8326 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2066177 T8326 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2066177 T8326 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2066178 T8326 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2066178 T8326 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2066182 T8327 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@58f304b4[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 2066186 T8326 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2066186 T8330 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59953/aa/cd collection:collection1 shard:shard2
[junit4] 2> 2066187 T8261 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4] 2> 2066187 T8261 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2066187 T8330 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2066189 T8261 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2066189 T8261 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 30000 for each attempt
[junit4] 2> 2066190 T8261 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
[junit4] 2> 2066190 T8261 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2066192 T8330 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2066193 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2066193 T8330 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2066194 T8330 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C984 name=collection1 org.apache.solr.core.SolrCore@6b174f1 url=http://127.0.0.1:59953/aa/cd/collection1 node=127.0.0.1:59953_aa%2Fcd C984_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59953/aa/cd, core=collection1, node_name=127.0.0.1:59953_aa%2Fcd}
[junit4] 2> 2066194 T8330 C984 P59953 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59953/aa/cd/collection1/
[junit4] 2> 2066194 T8330 C984 P59953 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2066194 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2066194 T8330 C984 P59953 oasc.SyncStrategy.syncToMe http://127.0.0.1:59953/aa/cd/collection1/ has no replicas
[junit4] 2> 2066195 T8330 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59953/aa/cd/collection1/ shard2
[junit4] 2> 2066195 T8330 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2066197 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2066197 T8325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066197 T8306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066197 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066197 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066200 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2066202 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2066304 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066304 T8306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066304 T8325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066304 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066352 T8330 oasc.ZkController.register We are http://127.0.0.1:59953/aa/cd/collection1/ and leader is http://127.0.0.1:59953/aa/cd/collection1/
[junit4] 2> 2066353 T8330 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59953/aa/cd
[junit4] 2> 2066353 T8330 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2066353 T8330 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2066353 T8330 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2066354 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2066355 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2066355 T8330 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2066355 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2066356 T8284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2066356 T8284 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:59953/aa/cd",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59953_aa%2Fcd",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 2066358 T8283 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2066460 T8306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066460 T8283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066460 T8325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2066460 T8293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2067192 T8261 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2067193 T8261 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4] 2> 2067195 T8291 oasc.SocketProxy$Acceptor.run accepted Socket[addr=/140.211.11.196,port=46752,localport=11796], receiveBufferSize:6565888
[junit4] 2> 2067205 T8291 oasc.SocketProxy$Bridge.<init> proxy connection Socket[addr=/127.0.0.1,port=55890,localport=29558], receiveBufferSize=6565888
[junit4] 2> ASYNC NEW_CORE C985 name=collection1 org.apache.solr.core.SolrCore@6145b4c4 url=http://127.0.0.1:11796/aa/cd/collection1 node=127.0.0.1:11796_aa%2Fcd C985_STATE=coll:control_collection core:collection1 props:{state=active, base_url=http://127.0.0.1:11796/aa/cd, core=collection1, node_name=127.0.0.1:11796_aa%2Fcd, leader=true}
[junit4] 2> 2067206 T8273 C985 P11796 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2067206 T8273 C985 P11796 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2067207 T8273 C985 P11796 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
[junit4] 2> 2067207 T8273 C985 P11796 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2067207 T8273 C985 P11796 oasup.LogUpdateProcessor.finish [collection1] webapp=/aa/cd path=/update params={commit=true&waitSearcher=true&version=2&wt=javabin&softCommit=false} {commit=} 0 1
[junit4] 2> 2067209 T8331 oasc.SocketProxy$Acceptor.run accepted Socket[addr=/140.211.11.196,port=56056,localport=59953], receiveBufferSize:6565888
[junit4] 2> 2067211 T8331 oasc.SocketProxy$Bridge.<init> proxy connection Socket[addr=/127.0.0.1,port=21654,localport=30944], receiveBufferSize=6565888
[junit
[...truncated too long message...]
se>>]
[junit4] 2> 2901862 T8325 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001/tempDir-004/c8n_1x3_lf_shard1_replica3/data/index
[junit4] 2> 2901862 T8325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2901862 T8325 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2901862 T8325 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2901863 T8325 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2901895 T8261 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 2901897 T8261 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:20510 20510
[junit4] 2> 2904127 T8262 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:20510 20510
[junit4] 2> 2904129 T8261 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:59953/aa/cd
[junit4] 2> 2904129 T8261 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:11796/aa/cd
[junit4] 2> 2904130 T8261 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:51322/aa/cd
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HttpPartitionTest -Dtests.method=testDistribSearch -Dtests.seed=9E1A0B8C7271ED55 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=vi -Dtests.timezone=Etc/GMT+11 -Dtests.file.encoding=UTF-8
[junit4] ERROR 849s J1 | HttpPartitionTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: No registered leader was found after waiting for 60000ms , collection: c8n_1x3_lf slice: shard1
[junit4] > at __randomizedtesting.SeedInfo.seed([9E1A0B8C7271ED55:1FFC8594052E8D69]:0)
[junit4] > at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:567)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.testRf3WithLeaderFailover(HttpPartitionTest.java:349)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:148)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2904157 T8261 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-9E1A0B8C7271ED55-001
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=DefaultSimilarity, locale=vi, timezone=Etc/GMT+11
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=35790336,total=249561088
[junit4] 2> NOTE: All tests run in this JVM: [DirectSolrConnectionTest, TestRecovery, ModifyConfFileTest, TestStressLucene, TestRequestStatusCollectionAPI, TermVectorComponentTest, DistributedQueryElevationComponentTest, BinaryUpdateRequestHandlerTest, TestSimpleQParserPlugin, TestSolrXmlPersistor, TestReversedWildcardFilterFactory, DirectUpdateHandlerOptimizeTest, TestPHPSerializedResponseWriter, DeleteReplicaTest, CoreMergeIndexesAdminHandlerTest, TestOmitPositions, TestSolrQueryParserResource, TestShortCircuitedRequests, TestLRUCache, RankQueryTest, SolrRequestParserTest, TestDefaultSearchFieldResource, TestDocumentBuilder, TestQueryUtils, TestSuggestSpellingConverter, TestBinaryField, AsyncMigrateRouteKeyTest, OverseerRolesTest, UniqFieldsUpdateProcessorFactoryTest, MigrateRouteKeyTest, AtomicUpdatesTest, LeaderElectionIntegrationTest, TestXIncludeConfig, SynonymTokenizerTest, TestPhraseSuggestions, SolrCoreTest, PolyFieldTest, DocValuesTest, TestRestManager, TestNonDefinedSimilarityFactory, TestCollectionAPI, TestImplicitCoreProperties, UpdateRequestProcessorFactoryTest, SoftAutoCommitTest, TestSchemaVersionResource, HdfsBasicDistributedZk2Test, AbstractAnalyticsFacetTest, TestQueryTypes, StressHdfsTest, SortByFunctionTest, NoFacetTest, TestWriterPerf, DefaultValueUpdateProcessorTest, ConvertedLegacyTest, AnalysisAfterCoreReloadTest, HardAutoCommitTest, AlternateDirectoryTest, TestRealTimeGet, SSLMigrationTest, FullSolrCloudDistribCmdsTest, LoggingHandlerTest, URLClassifyProcessorTest, DistribCursorPagingTest, ResourceLoaderTest, FileBasedSpellCheckerTest, TestDistributedGrouping, DebugComponentTest, TestStressUserVersions, SolrXmlInZkTest, TestMiniSolrCloudCluster, OutputWriterTest, CursorPagingTest, RemoteQueryErrorTest, UUIDFieldTest, TestDistribDocBasedVersion, BasicZkTest, TestSchemaNameResource, TestCollationField, SliceStateTest, TestCollapseQParserPlugin, QueryElevationComponentTest, TestExpandComponent, TestInitQParser, TestSystemIdResolver, TestIndexingPerformance, TestLazyCores, CoreContainerCoreInitFailuresTest, OpenCloseCoreStressTest, TestBM25SimilarityFactory, TestSolrQueryParser, ChaosMonkeySafeLeaderTest, TestSolrXMLSerializer, SearchHandlerTest, DistributedSuggestComponentTest, DateMathParserTest, LegacyHTMLStripCharFilterTest, MultiTermTest, HdfsRecoveryZkTest, RequestHandlersTest, BasicDistributedZk2Test, SyncSliceTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, StatelessScriptUpdateProcessorFactoryTest, DistanceFunctionTest, XsltUpdateRequestHandlerTest, CacheHeaderTest, LukeRequestHandlerTest, DocumentBuilderTest, MoreLikeThisHandlerTest, FastVectorHighlighterTest, SolrPluginUtilsTest, TestCSVResponseWriter, QueryParsingTest, JsonLoaderTest, PingRequestHandlerTest, TestComponentsName, SOLR749Test, CopyFieldTest, SolrIndexConfigTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, SampleTest, TestDocSet, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestFastOutputStream, ScriptEngineTest, TestFastLRUCache, DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, SystemInfoHandlerTest, FileUtilsTest, CircularListTest, TestRTGBase, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestHighlightDedupGrouping, TestTolerantSearch, FieldFacetTest, RangeFacetTest, AliasIntegrationTest, AssignTest, CollectionsAPIAsyncDistributedZkTest, DeleteShardTest, HttpPartitionTest]
[junit4] Completed on J1 in 849.16s, 1 test, 1 error <<< FAILURES!
[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1298: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:922: There were test failures: 417 suites, 1708 tests, 1 error, 52 ignored (18 assumptions)
Total time: 91 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-trunk-Java7 #4765
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 188598482 bytes
Compression is 0.0%
Took 32 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4768 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4768/
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandlerBackup
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup: 1) Thread[id=9716, name=Thread-4397, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup] at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at java.net.Socket.connect(Socket.java:528) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323) at java.net.URL.openStream(URL.java:1037) at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:314)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup:
1) Thread[id=9716, name=Thread-4397, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
at java.net.URL.openStream(URL.java:1037)
at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:314)
at __randomizedtesting.SeedInfo.seed([8F5BBC3D92042328]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandlerBackup
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=9716, name=Thread-4397, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup] at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at java.net.Socket.connect(Socket.java:528) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323) at java.net.URL.openStream(URL.java:1037) at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:314)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=9716, name=Thread-4397, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
at java.net.URL.openStream(URL.java:1037)
at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:314)
at __randomizedtesting.SeedInfo.seed([8F5BBC3D92042328]:0)
FAILED: org.apache.solr.cloud.HttpPartitionTest.testDistribSearch
Error Message:
No registered leader was found after waiting for 60000ms , collection: c8n_1x3_lf slice: shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 60000ms , collection: c8n_1x3_lf slice: shard1
at __randomizedtesting.SeedInfo.seed([8F5BBC3D92042328:EBD3225E55B4314]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:567)
at org.apache.solr.cloud.HttpPartitionTest.testRf3WithLeaderFailover(HttpPartitionTest.java:349)
at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:148)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11171 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/init-core-data-001
[junit4] 2> 681765 T8959 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 681770 T8959 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 681771 T8959 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 681772 T8960 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 681873 T8959 oasc.ZkTestServer.run start zk server on port:34280
[junit4] 2> 681875 T8959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 681878 T8966 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67f3d477 name:ZooKeeperConnection Watcher:127.0.0.1:34280 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 681878 T8959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 681879 T8959 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 681882 T8959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 681883 T8968 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5dcf64ff name:ZooKeeperConnection Watcher:127.0.0.1:34280/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 681884 T8959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 681884 T8959 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 681886 T8959 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 681888 T8959 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 681889 T8959 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 681891 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 681892 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 681894 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 681895 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 681998 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 681998 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 682001 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 682001 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 682003 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 682004 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 682006 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 682006 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 682008 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 682009 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 682011 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 682011 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 682013 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 682014 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 682016 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 682016 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 682018 T8959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 682019 T8959 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 683073 T8959 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 683078 T8959 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:54979
[junit4] 2> 683079 T8959 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 683079 T8959 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 683079 T8959 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-002
[junit4] 2> 683079 T8959 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-002/'
[junit4] 2> 683111 T8959 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-002/solr.xml
[junit4] 2> 683165 T8959 oasc.CoreContainer.<init> New CoreContainer 1347743728
[junit4] 2> 683165 T8959 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-002/]
[junit4] 2> 683166 T8959 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 683167 T8959 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 683167 T8959 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 683167 T8959 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 683167 T8959 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 683168 T8959 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 683168 T8959 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 683168 T8959 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 683168 T8959 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 683169 T8959 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 683169 T8959 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 683169 T8959 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 683170 T8959 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34280/solr
[junit4] 2> 683170 T8959 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 683171 T8959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 683172 T8979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78549ec3 name:ZooKeeperConnection Watcher:127.0.0.1:34280 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 683172 T8959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 683175 T8959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 683176 T8981 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3442d74d name:ZooKeeperConnection Watcher:127.0.0.1:34280/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 683176 T8959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 683178 T8959 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 683180 T8959 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 683183 T8959 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 683185 T8959 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 683187 T8959 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 683189 T8959 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 683190 T8959 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47012_
[junit4] 2> 683191 T8959 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47012_
[junit4] 2> 683193 T8959 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 683194 T8959 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 683197 T8959 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:47012_
[junit4] 2> 683197 T8959 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 683199 T8959 oasc.Overseer.start Overseer (id=92074929203707907-127.0.0.1:47012_-n_0000000000) starting
[junit4] 2> 683201 T8959 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 683207 T8983 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 683208 T8959 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 683210 T8959 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 683211 T8959 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 683212 T8982 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 683216 T8984 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 683216 T8984 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 683217 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 683217 T8984 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 683218 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 683218 T8982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:47012",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47012_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 683219 T8982 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 683219 T8982 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 683220 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 683221 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 684218 T8984 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 684219 T8984 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 684220 T8984 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 684220 T8984 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 684221 T8984 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 684221 T8984 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-002/collection1/'
[junit4] 2> 684222 T8984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 684223 T8984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 684224 T8984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 684289 T8984 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 684338 T8984 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 684440 T8984 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 684452 T8984 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 684854 T8984 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 684869 T8984 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 684872 T8984 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 684884 T8984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 684889 T8984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 684893 T8984 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 684894 T8984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 684894 T8984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 684894 T8984 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 684895 T8984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 684895 T8984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 684896 T8984 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 684896 T8984 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 684896 T8984 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-002/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/control/data/
[junit4] 2> 684897 T8984 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e85e47e
[junit4] 2> 684897 T8984 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/control/data
[junit4] 2> 684898 T8984 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/control/data/index/
[junit4] 2> 684898 T8984 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 684898 T8984 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/control/data/index
[junit4] 2> 684899 T8984 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1795839049, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 684900 T8984 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b593090 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@66d50ced),segFN=segments_1,generation=1}
[junit4] 2> 684900 T8984 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 684905 T8984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 684906 T8984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 684906 T8984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 684907 T8984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 684907 T8984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 684907 T8984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 684908 T8984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 684908 T8984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 684908 T8984 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 684909 T8984 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 684910 T8984 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 684910 T8984 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 684910 T8984 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 684911 T8984 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 684911 T8984 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 684912 T8984 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 684912 T8984 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 684931 T8984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 684937 T8984 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 684937 T8984 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 684938 T8984 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1507254635543184]
[junit4] 2> 684938 T8984 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b593090 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@66d50ced),segFN=segments_1,generation=1}
[junit4] 2> 684939 T8984 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 684939 T8984 oass.SolrIndexSearcher.<init> Opening Searcher@515ca36d[collection1] main
[junit4] 2> 684939 T8984 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 684940 T8984 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 684941 T8984 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 684941 T8984 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 684941 T8984 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 684942 T8984 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 684942 T8984 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 684942 T8984 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 684943 T8984 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 684945 T8984 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 684945 T8984 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 684945 T8984 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 684949 T8985 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@515ca36d[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 684952 T8984 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 684953 T8988 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47012 collection:control_collection shard:shard1
[junit4] 2> 684953 T8959 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4] 2> 684954 T8959 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 684954 T8988 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 684958 T8959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684959 T8988 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 684959 T8991 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7cc6165b name:ZooKeeperConnection Watcher:127.0.0.1:34280/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684960 T8959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684961 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 684961 T8988 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 684961 T8959 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684961 T8988 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 684962 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C519 name=collection1 org.apache.solr.core.SolrCore@716069b9 url=http://127.0.0.1:47012/collection1 node=127.0.0.1:47012_ C519_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:47012, core=collection1, node_name=127.0.0.1:47012_}
[junit4] 2> 684962 T8988 C519 P47012 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47012/collection1/
[junit4] 2> 684963 T8988 C519 P47012 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 684963 T8988 C519 P47012 oasc.SyncStrategy.syncToMe http://127.0.0.1:47012/collection1/ has no replicas
[junit4] 2> 684963 T8988 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47012/collection1/ shard1
[junit4] 2> 684963 T8959 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 684963 T8988 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 684964 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 684965 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 684965 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 684968 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 684969 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 684971 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 685074 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 685074 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 685122 T8988 oasc.ZkController.register We are http://127.0.0.1:47012/collection1/ and leader is http://127.0.0.1:47012/collection1/
[junit4] 2> 685123 T8988 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47012
[junit4] 2> 685123 T8988 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 685123 T8988 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 685123 T8988 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 685125 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 685125 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 685125 T8988 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 685125 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 685126 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 685127 T8982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:47012",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47012_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 685128 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 685231 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 685231 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 686033 T8959 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 686033 T8959 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 686036 T8959 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22281
[junit4] 2> 686037 T8959 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 686037 T8959 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 686037 T8959 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-003
[junit4] 2> 686038 T8959 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-003/'
[junit4] 2> 686069 T8959 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-003/solr.xml
[junit4] 2> 686122 T8959 oasc.CoreContainer.<init> New CoreContainer 1977810050
[junit4] 2> 686122 T8959 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-003/]
[junit4] 2> 686123 T8959 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 686123 T8959 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 686124 T8959 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 686124 T8959 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 686124 T8959 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 686124 T8959 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 686125 T8959 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 686125 T8959 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 686125 T8959 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 686126 T8959 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 686126 T8959 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 686126 T8959 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 686127 T8959 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34280/solr
[junit4] 2> 686127 T8959 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 686128 T8959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 686129 T9002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@92ff745 name:ZooKeeperConnection Watcher:127.0.0.1:34280 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 686130 T8959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 686132 T8959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 686133 T9004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f12ec34 name:ZooKeeperConnection Watcher:127.0.0.1:34280/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 686133 T8959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 686138 T8959 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 687142 T8959 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50864_
[junit4] 2> 687143 T8959 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50864_
[junit4] 2> 687153 T9005 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 687154 T9005 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 687155 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 687155 T9005 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 687155 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 687155 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 687156 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 687156 T8982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50864",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50864_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 687157 T8982 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 687157 T8982 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 687158 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 687159 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 687159 T9004 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 687159 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 688155 T9005 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 688156 T9005 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 688157 T9005 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 688157 T9005 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 688158 T9005 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 688158 T9005 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-003/collection1/'
[junit4] 2> 688159 T9005 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 688160 T9005 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 688161 T9005 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 688227 T9005 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 688297 T9005 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 688399 T9005 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 688411 T9005 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 688792 T9005 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 688807 T9005 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 688811 T9005 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 688823 T9005 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 688827 T9005 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 688831 T9005 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 688832 T9005 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 688832 T9005 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 688833 T9005 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 688834 T9005 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 688834 T9005 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 688834 T9005 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 688834 T9005 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 688835 T9005 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-003/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty1/
[junit4] 2> 688835 T9005 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e85e47e
[junit4] 2> 688836 T9005 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty1
[junit4] 2> 688836 T9005 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty1/index/
[junit4] 2> 688836 T9005 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 688837 T9005 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty1/index
[junit4] 2> 688839 T9005 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1795839049, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 688840 T9005 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1bbffdb0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@578e1df3),segFN=segments_1,generation=1}
[junit4] 2> 688840 T9005 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 688847 T9005 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 688847 T9005 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 688848 T9005 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 688848 T9005 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 688848 T9005 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 688849 T9005 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 688849 T9005 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 688850 T9005 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 688850 T9005 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 688851 T9005 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 688851 T9005 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 688852 T9005 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 688852 T9005 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 688853 T9005 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 688853 T9005 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 688854 T9005 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 688855 T9005 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 688874 T9005 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 688879 T9005 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 688879 T9005 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 688880 T9005 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1507254635543184]
[junit4] 2> 688881 T9005 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1bbffdb0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@578e1df3),segFN=segments_1,generation=1}
[junit4] 2> 688881 T9005 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 688882 T9005 oass.SolrIndexSearcher.<init> Opening Searcher@7bd0546c[collection1] main
[junit4] 2> 688882 T9005 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 688883 T9005 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 688883 T9005 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 688884 T9005 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 688884 T9005 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 688884 T9005 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 688885 T9005 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 688885 T9005 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 688886 T9005 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 688886 T9005 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 688890 T9006 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7bd0546c[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 688894 T9005 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 688895 T9009 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50864 collection:collection1 shard:shard1
[junit4] 2> 688895 T8959 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4] 2> 688896 T8959 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 688896 T9009 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 688901 T9009 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 688902 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 688902 T9009 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 688903 T9009 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C520 name=collection1 org.apache.solr.core.SolrCore@2855c262 url=http://127.0.0.1:50864/collection1 node=127.0.0.1:50864_ C520_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:50864, core=collection1, node_name=127.0.0.1:50864_}
[junit4] 2> 688903 T9009 C520 P50864 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50864/collection1/
[junit4] 2> 688903 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 688903 T9009 C520 P50864 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 688904 T9009 C520 P50864 oasc.SyncStrategy.syncToMe http://127.0.0.1:50864/collection1/ has no replicas
[junit4] 2> 688904 T9009 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50864/collection1/ shard1
[junit4] 2> 688904 T9009 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 688905 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 688906 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 688906 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 688906 T9004 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 688909 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 688911 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 689013 T9004 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 689013 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 689013 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 689063 T9009 oasc.ZkController.register We are http://127.0.0.1:50864/collection1/ and leader is http://127.0.0.1:50864/collection1/
[junit4] 2> 689064 T9009 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50864
[junit4] 2> 689064 T9009 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 689064 T9009 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 689064 T9009 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 689065 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 689066 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 689066 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 689066 T9009 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 689067 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 689068 T8982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:50864",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50864_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 689069 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 689172 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 689172 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 689172 T9004 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 689988 T8959 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 689989 T8959 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 689991 T8959 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:54174
[junit4] 2> 689992 T8959 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 689992 T8959 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 689992 T8959 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-004
[junit4] 2> 689993 T8959 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-004/'
[junit4] 2> 690024 T8959 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-004/solr.xml
[junit4] 2> 690077 T8959 oasc.CoreContainer.<init> New CoreContainer 1609191439
[junit4] 2> 690077 T8959 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-004/]
[junit4] 2> 690078 T8959 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 690078 T8959 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 690079 T8959 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 690079 T8959 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 690079 T8959 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 690079 T8959 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 690080 T8959 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 690080 T8959 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 690080 T8959 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 690081 T8959 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 690081 T8959 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 690081 T8959 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 690082 T8959 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34280/solr
[junit4] 2> 690082 T8959 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 690083 T8959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 690084 T9021 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@102e39fb name:ZooKeeperConnection Watcher:127.0.0.1:34280 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 690084 T8959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 690086 T8959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 690105 T9023 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24fc6736 name:ZooKeeperConnection Watcher:127.0.0.1:34280/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 690106 T8959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 690111 T8959 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 691115 T8959 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28914_
[junit4] 2> 691116 T8959 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28914_
[junit4] 2> 691126 T9024 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 691127 T9024 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 691127 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 691127 T9024 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 691128 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 691128 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 691129 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 691130 T8982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:28914",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:28914_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 691130 T8982 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 691130 T8982 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 691132 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 691132 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 691132 T9023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 691132 T9004 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 691132 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 692128 T9024 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 692129 T9024 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 692129 T9024 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 692130 T9024 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 692130 T9024 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 692131 T9024 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-004/collection1/'
[junit4] 2> 692132 T9024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 692133 T9024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 692134 T9024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 692199 T9024 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 692248 T9024 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 692350 T9024 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 692362 T9024 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 692745 T9024 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 692759 T9024 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 692763 T9024 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 692774 T9024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 692779 T9024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 692783 T9024 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 692784 T9024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 692784 T9024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 692784 T9024 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 692785 T9024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 692785 T9024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 692786 T9024 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 692786 T9024 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 692786 T9024 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-004/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty2/
[junit4] 2> 692787 T9024 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e85e47e
[junit4] 2> 692788 T9024 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty2
[junit4] 2> 692788 T9024 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty2/index/
[junit4] 2> 692788 T9024 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 692789 T9024 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-8F5BBC3D92042328-001/tempDir-001/jetty2/index
[junit4] 2> 692789 T9024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1795839049, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 692790 T9024 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@9bdc8e4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6730ca6b),segFN=segments_1,generation=1}
[junit4] 2> 692790 T9024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 692797 T9024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 692798 T9024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 692798 T9024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 692798 T9024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 692799 T9024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 692799 T9024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 692800 T9024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 692800 T9024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 692800 T9024 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 692801 T9024 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 692802 T9024 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 692802 T9024 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 692802 T9024 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 692803 T9024 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 692803 T9024 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 692804 T9024 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 692805 T9024 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 692823 T9024 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 692828 T9024 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 692828 T9024 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 692829 T9024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1507254635543184]
[junit4] 2> 692829 T9024 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@9bdc8e4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6730ca6b),segFN=segments_1,generation=1}
[junit4] 2> 692830 T9024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 692830 T9024 oass.SolrIndexSearcher.<init> Opening Searcher@17a94cf2[collection1] main
[junit4] 2> 692830 T9024 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 692831 T9024 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 692831 T9024 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 692832 T9024 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 692832 T9024 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 692832 T9024 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 692833 T9024 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 692834 T9024 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 692834 T9024 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 692834 T9024 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 692839 T9025 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17a94cf2[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 692842 T9024 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 692843 T9028 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28914 collection:collection1 shard:shard2
[junit4] 2> 692844 T8959 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4] 2> 692844 T8959 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 692844 T9028 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 692845 T8959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 692846 T8959 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 30000 for each attempt
[junit4] 2> 692847 T8959 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
[junit4] 2> 692847 T8959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 692848 T9028 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 692850 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 692850 T9028 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 692850 T9028 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C521 name=collection1 org.apache.solr.core.SolrCore@fbf3e76 url=http://127.0.0.1:28914/collection1 node=127.0.0.1:28914_ C521_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:28914, core=collection1, node_name=127.0.0.1:28914_}
[junit4] 2> 692850 T9028 C521 P28914 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:28914/collection1/
[junit4] 2> 692851 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 692851 T9028 C521 P28914 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 692851 T9028 C521 P28914 oasc.SyncStrategy.syncToMe http://127.0.0.1:28914/collection1/ has no replicas
[junit4] 2> 692851 T9028 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:28914/collection1/ shard2
[junit4] 2> 692852 T9028 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 692853 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 692853 T9004 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 692853 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 692853 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 692853 T9023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 692856 T8982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 692858 T8981 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 692960 T8981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 692960 T9004 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 692960 T8991 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 692960 T9023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 693009 T9028 oasc.ZkController.register We are http://127.0.0.1:28914/collection1/ and leader is http://127.0.0.1:28914/collection1/
[junit4] 2> 693010 T9028 oasc.ZkController.register No LogReplay needed for core
[...truncated too long message...]
52)
[junit4] 2> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
[junit4] 2> at java.net.URL.openStream(URL.java:1037)
[junit4] 2> at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:314)
[junit4] 2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=no, timezone=GB-Eire
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=2,free=327815832,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [ChaosMonkeySafeLeaderTest, TestDynamicFieldCollectionResource, SynonymTokenizerTest, TestCSVResponseWriter, TestSystemIdResolver, TestZkChroot, ZkSolrClientTest, TestOmitPositions, TestUpdate, SolrPluginUtilsTest, CopyFieldTest, TestCollationFieldDocValues, TestImplicitCoreProperties, RollingRestartTest, TestDistribDocBasedVersion, URLClassifyProcessorTest, TestSolrQueryParserResource, TestCursorMarkWithoutUniqueKey, SortByFunctionTest, RangeFacetTest, TestLazyCores, ShardRoutingCustomTest, TestDistributedGrouping, TestRandomFaceting, TestStressUserVersions, LeaderElectionIntegrationTest, TestRTGBase, AnalysisAfterCoreReloadTest, StressHdfsTest, SampleTest, TestMultiCoreConfBootstrap, TestLFUCache, BasicDistributedZk2Test, TestPostingsSolrHighlighter, UpdateRequestProcessorFactoryTest, TestIndexSearcher, NumericFieldsTest, SOLR749Test, TermVectorComponentDistributedTest, TestBlendedInfixSuggestions, DefaultValueUpdateProcessorTest, MergeStrategyTest, TestRealTimeGet, AlternateDirectoryTest, TestAtomicUpdateErrorCases, TestQueryUtils, DateRangeFieldTest, TestBadConfig, CoreContainerCoreInitFailuresTest, TestJmxMonitoredMap, CurrencyFieldXmlFileTest, TestRandomMergePolicy, DistribCursorPagingTest, TestStressLucene, DateMathParserTest, TestSweetSpotSimilarityFactory, QueryElevationComponentTest, TestCollapseQParserPlugin, TestPHPSerializedResponseWriter, TestBM25SimilarityFactory, OpenCloseCoreStressTest, SchemaVersionSpecificBehaviorTest, TestDocumentBuilder, DocValuesMissingTest, TestPhraseSuggestions, SolrRequestParserTest, TestReloadAndDeleteDocs, OverseerRolesTest, TestFieldCollectionResource, AtomicUpdatesTest, InfoHandlerTest, HdfsUnloadDistributedZkTest, FullSolrCloudDistribCmdsTest, IndexSchemaRuntimeFieldTest, DistributedQueryComponentOptimizationTest, TestJoin, TestMaxScoreQueryParser, ClusterStateTest, TestFunctionQuery, UUIDFieldTest, SoftAutoCommitTest, PolyFieldTest, MigrateRouteKeyTest, TestFieldSortValues, TestQuerySenderNoQuery, TestSerializedLuceneMatchVersion, RankQueryTest, TestBinaryField, TestRequestStatusCollectionAPI, CSVRequestHandlerTest, TestReversedWildcardFilterFactory, AsyncMigrateRouteKeyTest, BinaryUpdateRequestHandlerTest, TestCoreContainer, TestHighFrequencyDictionaryFactory, HdfsChaosMonkeySafeLeaderTest, TestSolrQueryParserDefaultOperatorResource, AddBlockUpdateTest, ScriptEngineTest, SuggesterFSTTest, SyncSliceTest, TestReplicationHandler, TestHashPartitioner, TestReload, DistributedTermsComponentTest, StatsComponentTest, TestGroupingSearch, DirectUpdateHandlerTest, HighlighterTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SimplePostToolTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SpellCheckCollatorTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, TestTrie, SuggesterWFSTTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, QueryEqualityTest, DocValuesMultiTest, TestSolrDeletionPolicy1, DebugComponentTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, DocumentAnalysisRequestHandlerTest, FileBasedSpellCheckerTest, RequestHandlersTest, TermVectorComponentTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, IndexSchemaTest, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, TestBinaryResponseWriter, TestSolrIndexConfig, SolrIndexConfigTest, TestStressRecovery, SpellPossibilityIteratorTest, TestCodecSupport, EchoParamsTest, TestIBSimilarityFactory, ResourceLoaderTest, TestSuggestSpellingConverter, DateFieldTest, SolrTestCaseJ4Test, TestDistributedMissingSort, TestHighlightDedupGrouping, ExpressionTest, AssignTest, CollectionsAPIAsyncDistributedZkTest, DeleteReplicaTest, DeleteShardTest, RemoteQueryErrorTest, ReplicationFactorTest, SSLMigrationTest, ShardSplitTest, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, HdfsRecoveryZkTest, HdfsWriteToMultipleCollectionsTest, TestConfigSets, TestNRTOpen, TestNonNRTOpen, TestSolrXmlPersistor, TestReplicationHandlerBackup]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestReplicationHandlerBackup -Dtests.seed=8F5BBC3D92042328 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=no -Dtests.timezone=GB-Eire -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestReplicationHandlerBackup (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup:
[junit4] > 1) Thread[id=9716, name=Thread-4397, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
[junit4] > at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
[junit4] > at java.net.Socket.connect(Socket.java:579)
[junit4] > at java.net.Socket.connect(Socket.java:528)
[junit4] > at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
[junit4] > at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
[junit4] > at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
[junit4] > at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
[junit4] > at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
[junit4] > at java.net.URL.openStream(URL.java:1037)
[junit4] > at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:314)
[junit4] > at __randomizedtesting.SeedInfo.seed([8F5BBC3D92042328]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=9716, name=Thread-4397, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
[junit4] > at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
[junit4] > at java.net.Socket.connect(Socket.java:579)
[junit4] > at java.net.Socket.connect(Socket.java:528)
[junit4] > at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
[junit4] > at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
[junit4] > at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
[junit4] > at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
[junit4] > at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
[junit4] > at java.net.URL.openStream(URL.java:1037)
[junit4] > at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:314)
[junit4] > at __randomizedtesting.SeedInfo.seed([8F5BBC3D92042328]:0)
[junit4] Completed on J1 in 25.18s, 1 test, 2 errors <<< FAILURES!
[...truncated 152 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1298: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:922: There were test failures: 418 suites, 1710 tests, 2 suite-level errors, 1 error, 161 ignored (18 assumptions)
Total time: 94 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-trunk-Java7 #4765
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 184135229 bytes
Compression is 0.0%
Took 33 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4767 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4767/
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([69B9D47C61E48CC6]:0)
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([69B9D47C61E48CC6:6DB15B8F734163E7]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:143)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:660)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:135)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:130)
... 47 more
FAILED: org.apache.solr.cloud.HttpPartitionTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([69B9D47C61E48CC6]:0)
Build Log:
[...truncated 11148 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.OverseerTest-69B9D47C61E48CC6-001/init-core-data-001
[junit4] 2> 2384952 T5881 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 2384952 T5881 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 2384953 T5881 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 2384957 T5881 oas.SolrTestCaseJ4.setUp ###Starting testDoubleAssignment
[junit4] 2> 2384958 T5881 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2384959 T5882 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2385059 T5881 oasc.ZkTestServer.run start zk server on port:33282
[junit4] 2> 2385060 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385064 T5888 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@521fe332 name:ZooKeeperConnection Watcher:127.0.0.1:33282/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385064 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385065 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385066 T5890 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58b64e59 name:ZooKeeperConnection Watcher:127.0.0.1:33282 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385066 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385068 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385069 T5892 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6afe1e2b name:ZooKeeperConnection Watcher:127.0.0.1:33282 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385070 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385070 T5881 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2385072 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2385074 T5881 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2385076 T5881 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2385077 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2385079 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385081 T5894 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3913774b name:ZooKeeperConnection Watcher:127.0.0.1:33282/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385081 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385082 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2385083 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2385085 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385087 T5896 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c70ac92 name:ZooKeeperConnection Watcher:127.0.0.1:33282/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385087 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385088 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2385089 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2385092 T5881 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33282_solr
[junit4] 2> 2385092 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2385093 T5881 oasc.Overseer.start Overseer (id=92069218549104644-127.0.0.1:33282_solr-n_0000000000) starting
[junit4] 2> 2385095 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2385096 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2385098 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2385100 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2385102 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2385104 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2385107 T5898 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2385108 T5897 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2385109 T5897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2385110 T5897 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2385110 T5897 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 2385110 T5897 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2385112 T5896 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2385112 T5894 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2385112 T5888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2385610 T5881 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2385615 T5881 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2385618 T5896 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2385619 T5881 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2385619 T5897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2385622 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385622 T5896 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2385623 T5900 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@477ba0fa name:ZooKeeperConnection Watcher:127.0.0.1:33282/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385624 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385625 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2385626 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2385629 T5896 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2385629 T5881 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2385630 T5897 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2385630 T5897 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2385631 T5896 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2385632 T5881 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2385635 T5896 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2385637 T5896 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2385738 T5888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2385738 T5900 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2385738 T5881 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2385742 T5881 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33282 33282
[junit4] 2> 2385810 T5882 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33282 33282
[junit4] 2> 2385811 T5881 oas.SolrTestCaseJ4.tearDown ###Ending testDoubleAssignment
[junit4] 2> 2385812 T5897 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:33282_solr
[junit4] 2> 2385812 T5901 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2385818 T5881 oas.SolrTestCaseJ4.setUp ###Starting testPlaceholders
[junit4] 2> 2385819 T5881 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2385820 T5902 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2385920 T5881 oasc.ZkTestServer.run start zk server on port:33289
[junit4] 2> 2385921 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385924 T5908 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@638afcbf name:ZooKeeperConnection Watcher:127.0.0.1:33289/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385924 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385925 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385926 T5910 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e9af74d name:ZooKeeperConnection Watcher:127.0.0.1:33289 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385927 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385929 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385930 T5912 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f23e2e1 name:ZooKeeperConnection Watcher:127.0.0.1:33289 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385930 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385930 T5881 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2385933 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2385934 T5881 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2385936 T5881 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2385937 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2385939 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385940 T5914 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ce61cce name:ZooKeeperConnection Watcher:127.0.0.1:33289/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385940 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385941 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2385942 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2385944 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2385946 T5916 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5a3f04 name:ZooKeeperConnection Watcher:127.0.0.1:33289/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2385946 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2385947 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2385948 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2385951 T5881 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33289_solr
[junit4] 2> 2385951 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2385952 T5881 oasc.Overseer.start Overseer (id=92069218605531140-127.0.0.1:33289_solr-n_0000000000) starting
[junit4] 2> 2385953 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2385955 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2385957 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2385959 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2385961 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2385963 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2385966 T5918 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2385967 T5917 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2385968 T5917 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2385969 T5917 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"12",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2385969 T5917 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12]
[junit4] 2> 2385969 T5917 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard10
[junit4] 2> 2385971 T5916 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2385971 T5914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2385971 T5908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2386467 T5881 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard10/election
[junit4] 2> 2386473 T5881 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard10
[junit4] 2> 2386476 T5916 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2386476 T5881 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2386477 T5917 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2386477 T5917 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ClusterState.load(ClusterState.java:239)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:445)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:242)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:234)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2386479 T5917 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:33289_solr
[junit4] 2> 2386480 T5919 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2386480 T5881 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33289 33289
[junit4] 2> 2386540 T5902 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33289 33289
[junit4] 2> 2386541 T5881 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4] 2> 2386548 T5881 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4] 2> 2386549 T5881 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2386550 T5920 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2386649 T5881 oasc.ZkTestServer.run start zk server on port:33295
[junit4] 2> 2386650 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2386653 T5926 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57e51af4 name:ZooKeeperConnection Watcher:127.0.0.1:33295/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2386653 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2386654 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2386655 T5928 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53a944a name:ZooKeeperConnection Watcher:127.0.0.1:33295 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2386656 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2386658 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2386659 T5930 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@673aeb59 name:ZooKeeperConnection Watcher:127.0.0.1:33295 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2386659 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2386659 T5881 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2386662 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2386663 T5881 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2386665 T5881 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2386666 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2386668 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2386671 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2386672 T5932 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5470066d name:ZooKeeperConnection Watcher:127.0.0.1:33295/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2386672 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2386673 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2386674 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2386676 T5881 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33295_solr
[junit4] 2> 2386677 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2386678 T5881 oasc.Overseer.start Overseer (id=92069218653569027-127.0.0.1:33295_solr-n_0000000000) starting
[junit4] 2> 2386679 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2386682 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2386683 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2386685 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2386687 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2386690 T5934 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2386697 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2386698 T5933 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 2386698 T5933 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2386700 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2386703 T5933 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2386704 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2386705 T5933 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2386706 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2386706 T5933 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2386708 T5932 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2386809 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2386900 T5881 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33295 33295
[junit4] 2> 2387052 T5920 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33295 33295
[junit4] 2> 2387053 T5881 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4] 2> 2387054 T5933 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:33295_solr
[junit4] 2> 2387055 T5935 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2387060 T5881 oas.SolrTestCaseJ4.setUp ###Starting testStateChange
[junit4] 2> 2387061 T5881 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2387062 T5936 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2387162 T5881 oasc.ZkTestServer.run start zk server on port:33300
[junit4] 2> 2387163 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387166 T5942 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23f9f65a name:ZooKeeperConnection Watcher:127.0.0.1:33300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387166 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387167 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387168 T5944 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2203b204 name:ZooKeeperConnection Watcher:127.0.0.1:33300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387169 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387171 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387172 T5946 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@503fa094 name:ZooKeeperConnection Watcher:127.0.0.1:33300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387172 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387172 T5881 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2387175 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2387177 T5881 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2387178 T5881 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2387179 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387181 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387182 T5948 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ad8d36a name:ZooKeeperConnection Watcher:127.0.0.1:33300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387182 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387183 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2387185 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2387187 T5881 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33300_solr
[junit4] 2> 2387187 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2387189 T5881 oasc.Overseer.start Overseer (id=92069218686926851-127.0.0.1:33300_solr-n_0000000000) starting
[junit4] 2> 2387190 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2387192 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2387193 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2387195 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2387197 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2387199 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2387202 T5950 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2387203 T5949 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2387204 T5881 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2387204 T5949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2387205 T5949 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2387205 T5949 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2387207 T5948 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2387207 T5942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2387255 T5881 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2387256 T5948 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2387257 T5949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2387258 T5949 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"}
[junit4] 2> 2387258 T5949 oasc.Overseer$ClusterStateUpdater.updateState node=core_node1 is already registered
[junit4] 2> 2387258 T5949 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2387259 T5948 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2387361 T5942 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2387410 T5881 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33300 33300
[junit4] 2> 2387713 T5936 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33300 33300
[junit4] 2> 2387714 T5881 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4] 2> 2387714 T5949 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:33300_solr
[junit4] 2> 2387715 T5951 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2387720 T5881 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 2387721 T5881 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2387722 T5952 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2387822 T5881 oasc.ZkTestServer.run start zk server on port:33305
[junit4] 2> 2387823 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387826 T5958 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bfc2cd name:ZooKeeperConnection Watcher:127.0.0.1:33305 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387826 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387828 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387830 T5960 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3da61fee name:ZooKeeperConnection Watcher:127.0.0.1:33305 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387830 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387830 T5881 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2387833 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387834 T5962 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dc8983b name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387834 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387835 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2387837 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387838 T5964 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19f3c588 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387838 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387839 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2387840 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2387843 T5881 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33305_solr
[junit4] 2> 2387843 T5881 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2387845 T5881 oasc.Overseer.start Overseer (id=92069218730180611-127.0.0.1:33305_solr-n_0000000000) starting
[junit4] 2> 2387846 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2387848 T5881 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2387850 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2387851 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2387853 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2387855 T5881 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2387859 T5966 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2387859 T5881 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2387859 T5965 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2387860 T5881 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2387861 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387863 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387864 T5968 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65b335bc name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387865 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387866 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387867 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 2387869 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387870 T5970 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6996f641 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387870 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387871 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387873 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2387875 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387876 T5972 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@470184d6 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387876 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387877 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387879 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 2387881 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387882 T5974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d08174b name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387882 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387883 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387885 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 2387887 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387888 T5976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16e8a4b7 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387888 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387889 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387891 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 2387893 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387894 T5978 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18f6ca40 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387894 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387895 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387897 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 2387899 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387900 T5980 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ae92a34 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387900 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387901 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387903 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 2387905 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387906 T5982 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a11190 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387906 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387908 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387909 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 2387911 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387913 T5984 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f797d34 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387913 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387914 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387915 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 2387918 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387919 T5986 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17bb495e name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387919 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387920 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387921 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 2387924 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387925 T5988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b99b513 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387926 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387927 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387928 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 2387931 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387932 T5990 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e6bb908 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387932 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387933 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387935 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 2387937 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387939 T5992 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@639c4714 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387939 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387940 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387941 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 2387944 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387945 T5994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44cca6c9 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387946 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387947 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387948 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 2387951 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387952 T5996 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6395bde0 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387952 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387953 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387955 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 2387957 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387959 T5998 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66f2facb name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387959 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387960 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387961 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 2387964 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387965 T6000 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31eea1fb name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387965 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387966 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387968 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 2387971 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387972 T6002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6455372e name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387972 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387973 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387974 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 2387977 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387978 T6004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f7d0fb name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387979 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387980 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387981 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 2387984 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387985 T6006 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37c6f2ab name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387985 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387986 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387988 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 2387991 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387992 T6008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@662c004b name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387992 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2387993 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2387995 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 2387998 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2387999 T6010 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1af3cef9 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2387999 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388000 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388001 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 2388005 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388006 T6012 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63e12b4d name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388006 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388007 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388009 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4] 2> 2388012 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388013 T6014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e83432f name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388013 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388014 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388015 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4] 2> 2388020 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388021 T6016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a460e04 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388021 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388022 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388023 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4] 2> 2388026 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388028 T6018 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@322d75f4 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388028 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388029 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388030 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4] 2> 2388033 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388035 T6020 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e3fe69c name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388035 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388036 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388037 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
[junit4] 2> 2388041 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388042 T6022 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45f9c54c name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388042 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388043 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388045 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
[junit4] 2> 2388049 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388050 T6024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@190e74a8 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388050 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388051 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388052 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
[junit4] 2> 2388056 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388057 T6026 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79033d13 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388057 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388058 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388060 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
[junit4] 2> 2388064 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388065 T6028 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11536a1c name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388065 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388066 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388068 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
[junit4] 2> 2388071 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388072 T6030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51949e3c name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388073 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388074 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388075 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
[junit4] 2> 2388079 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388080 T6032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62a2deff name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388080 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388081 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388082 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
[junit4] 2> 2388086 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388087 T6034 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63d9925a name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388087 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388088 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388090 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node33
[junit4] 2> 2388094 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388095 T6036 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c1b3fe4 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388095 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388096 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388097 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node34
[junit4] 2> 2388101 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388102 T6038 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@292ad365 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388103 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388103 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388105 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node35
[junit4] 2> 2388109 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388110 T6040 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e692554 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388110 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388111 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388112 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node36
[junit4] 2> 2388116 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388117 T6042 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7027c7dc name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388118 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388118 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388120 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node37
[junit4] 2> 2388124 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388125 T6044 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a3451ad name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388125 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388126 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388127 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node38
[junit4] 2> 2388131 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388132 T6046 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@519cb14a name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388133 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388133 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388135 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node39
[junit4] 2> 2388139 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388140 T6048 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70d0373f name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388140 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388141 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388142 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node40
[junit4] 2> 2388146 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388148 T6050 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@161bd4d5 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388148 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388149 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388150 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node41
[junit4] 2> 2388154 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388156 T6052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ead6515 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388156 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388157 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388158 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node42
[junit4] 2> 2388163 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388164 T6054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77cfedaf name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388164 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388165 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388166 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node43
[junit4] 2> 2388170 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388172 T6056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3291c777 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388172 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388173 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388174 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node44
[junit4] 2> 2388179 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388180 T6058 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@139bd25b name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388180 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388181 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388182 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node45
[junit4] 2> 2388187 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388188 T6060 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fc20ab7 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388188 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388189 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388190 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node46
[junit4] 2> 2388195 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388196 T6062 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@169dbb0b name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388196 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388197 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388199 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node47
[junit4] 2> 2388204 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388205 T6064 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b53f634 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388205 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388206 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388208 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node48
[junit4] 2> 2388213 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388214 T6066 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d647f5b name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388214 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388215 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388216 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node49
[junit4] 2> 2388221 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388222 T6068 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19c9c852 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388223 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388223 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388225 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node50
[junit4] 2> 2388230 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388231 T6070 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11af6ccc name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388231 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388232 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388234 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node51
[junit4] 2> 2388239 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388240 T6072 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15120002 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388240 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388241 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388243 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node52
[junit4] 2> 2388248 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388249 T6074 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cf1cd67 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388249 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388250 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388252 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node53
[junit4] 2> 2388257 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388258 T6076 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a7ac9da name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388259 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388259 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388261 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node54
[junit4] 2> 2388266 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388268 T6078 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43c7ca74 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388268 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388269 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388270 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node55
[junit4] 2> 2388276 T5881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2388277 T6080 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12cb8785 name:ZooKeeperConnection Watcher:127.0.0.1:33305/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2388277 T5881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2388278 T5881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2388279 T5881 oascc.SolrZkClient.makePath makePath: /live_nodes/node56
[junit4] 2> 2388288 T5964 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2388290 T5964 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2388292 T5965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2388295 T5965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=18 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node0",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"18",
[junit4] 2> "base_url":"http://node0/solr/"}
[junit4] 2> 2388295 T5965 oasc.Overseer$ClusterStateUpdater.
[...truncated too long message...]
520 T12 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 24697
[junit4] 2> 7220931 T11 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=12, name=TEST-HttpPartitionTest.testDistribSearch-seed#[69B9D47C61E48CC6], state=WAITING, group=TGRP-HttpPartitionTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:503)
[junit4] 2> at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342)
[junit4] 2> at org.apache.zookeeper.ClientCnxn.close(ClientCnxn.java:1314)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.close(ZooKeeper.java:677)
[junit4] 2> at org.apache.solr.common.cloud.SolrZooKeeper.close(SolrZooKeeper.java:99)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.closeKeeper(SolrZkClient.java:601)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.close(SolrZkClient.java:570)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.close(ZkStateReader.java:527)
[junit4] 2> at org.apache.solr.client.solrj.impl.CloudSolrServer.shutdown(CloudSolrServer.java:692)
[junit4] 2> at org.apache.solr.cloud.AbstractFullDistribZkTestBase.tearDown(AbstractFullDistribZkTestBase.java:1423)
[junit4] 2> at org.apache.solr.cloud.HttpPartitionTest.tearDown(HttpPartitionTest.java:85)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:885)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2) Thread[id=44, name=TEST-HttpPartitionTest.testDistribSearch-seed#[69B9D47C61E48CC6]-SendThread(127.0.0.1:22263), state=RUNNABLE, group=TGRP-HttpPartitionTest]
[junit4] 2> at sun.nio.ch.IOUtil.drain(Native Method)
[junit4] 2> at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167)
[junit4] 2> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
[junit4] 2> NOTE: test params are: codec=Lucene49: {multiDefault=PostingsFormat(name=FSTOrdPulsing41), _version_=PostingsFormat(name=MockRandom), text=PostingsFormat(name=SimpleText), a_t=PostingsFormat(name=FSTOrdPulsing41), range_facet_l=PostingsFormat(name=FSTOrdPulsing41), intDefault=PostingsFormat(name=MockRandom), id=PostingsFormat(name=Lucene41WithOrds), timestamp=PostingsFormat(name=FSTOrdPulsing41)}, docValues:{timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=sr_RS_#Latn, timezone=ART
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=4,free=52336120,total=175112192
[junit4] 2> NOTE: All tests run in this JVM: [HttpPartitionTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HttpPartitionTest -Dtests.seed=69B9D47C61E48CC6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr_RS_#Latn -Dtests.timezone=ART -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J0 | HttpPartitionTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([69B9D47C61E48CC6]:0)
[junit4] Completed on J0 in 7224.51s, 1 test, 2 errors <<< FAILURES!
[...truncated 317 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1298: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:922: There were test failures: 417 suites, 1708 tests, 1 suite-level error, 2 errors, 444 ignored (18 assumptions)
Total time: 165 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-trunk-Java7 #4765
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 167572826 bytes
Compression is 0.0%
Took 32 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure