You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/07/21 07:16:48 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/ibm-j9-jdk7) - Build #
6661 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6661/
Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:47682/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:47682/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([AFA56F7EE0081BA9:2E43E16697577B95]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:613)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:780)
Build Log:
[...truncated 9467 lines...]
[junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4] 2> 310174 T1185 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 310179 T1185 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1374382780592
[junit4] 2> 310180 T1185 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 310180 T1186 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 310281 T1185 oasc.ZkTestServer.run start zk server on port:38715
[junit4] 2> 310286 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 310400 T1192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e6bbf33a name:ZooKeeperConnection Watcher:127.0.0.1:38715 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 310401 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 310402 T1185 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 310409 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 310410 T1194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@829ac88f name:ZooKeeperConnection Watcher:127.0.0.1:38715/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 310411 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 310411 T1185 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 310414 T1185 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 310416 T1185 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 310418 T1185 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 310420 T1185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 310421 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 310424 T1185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 310425 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 310427 T1185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 310428 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 310430 T1185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 310431 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 310433 T1185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 310433 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 310436 T1185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 310437 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 310439 T1185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 310439 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 310442 T1185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 310442 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 310445 T1185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 310445 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 310519 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 310525 T1185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55024
[junit4] 2> 310526 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 310527 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 310527 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1374382780861
[junit4] 2> 310528 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1374382780861/'
[junit4] 2> 310537 T1185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1374382780861/solr.xml
[junit4] 2> 310569 T1185 oasc.CoreContainer.<init> New CoreContainer 1009508350
[junit4] 2> 310570 T1185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1374382780861/]
[junit4] 2> 310571 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 310572 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 310572 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 310573 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 310574 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 310574 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 310575 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 310576 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 310576 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 310577 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 310582 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 310582 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38715/solr
[junit4] 2> 310583 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 310586 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 310587 T1205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10a12117 name:ZooKeeperConnection Watcher:127.0.0.1:38715 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 310587 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 310589 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 310595 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 310596 T1207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b0cd959 name:ZooKeeperConnection Watcher:127.0.0.1:38715/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 310596 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 310598 T1185 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 310601 T1185 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 310603 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 310605 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55024_
[junit4] 2> 310606 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55024_
[junit4] 2> 310608 T1185 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 310612 T1185 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 310615 T1185 oasc.Overseer.start Overseer (id=90071549909270531-127.0.0.1:55024_-n_0000000000) starting
[junit4] 2> 310617 T1185 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 310620 T1209 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 310620 T1185 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 310622 T1185 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 310624 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 310626 T1208 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 310630 T1210 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 310630 T1210 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 310631 T1210 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 312130 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 312132 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55024",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:55024_",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1"}
[junit4] 2> 312133 T1208 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4] 2> 312134 T1208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 312140 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 312632 T1210 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 312633 T1210 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1374382780861/collection1
[junit4] 2> 312633 T1210 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 312635 T1210 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 312636 T1210 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 312638 T1210 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1374382780861/collection1/'
[junit4] 2> 312640 T1210 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1374382780861/collection1/lib/README' to classloader
[junit4] 2> 312662 T1210 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1374382780861/collection1/lib/classes/' to classloader
[junit4] 2> 312701 T1210 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 312732 T1210 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 312733 T1210 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 312740 T1210 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 313056 T1210 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 313062 T1210 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 313065 T1210 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 313078 T1210 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 313082 T1210 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 313086 T1210 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 313087 T1210 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 313088 T1210 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 313089 T1210 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 313090 T1210 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 313091 T1210 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 313091 T1210 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 313092 T1210 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1374382780861/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/control/data/
[junit4] 2> 313093 T1210 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3f082ac
[junit4] 2> 313094 T1210 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/control/data
[junit4] 2> 313094 T1210 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/control/data/index/
[junit4] 2> 313095 T1210 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 313096 T1210 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/control/data/index
[junit4] 2> 313098 T1210 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@158cb94 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6d2e660c),segFN=segments_1,generation=1}
[junit4] 2> 313098 T1210 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 313101 T1210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 313102 T1210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 313103 T1210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 313104 T1210 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 313104 T1210 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 313105 T1210 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 313105 T1210 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 313106 T1210 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 313107 T1210 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 313108 T1210 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 313111 T1210 oass.SolrIndexSearcher.<init> Opening Searcher@579d8daf main
[junit4] 2> 313112 T1210 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 313113 T1210 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 313117 T1211 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@579d8daf main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 313118 T1210 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 313119 T1210 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55024 collection:control_collection shard:shard1
[junit4] 2> 313119 T1210 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 313128 T1210 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 313138 T1210 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 313141 T1210 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 313142 T1210 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 313142 T1210 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55024/collection1/
[junit4] 2> 313142 T1210 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 313143 T1210 oasc.SyncStrategy.syncToMe http://127.0.0.1:55024/collection1/ has no replicas
[junit4] 2> 313143 T1210 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55024/collection1/ shard1
[junit4] 2> 313143 T1210 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 313647 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 313658 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 313704 T1210 oasc.ZkController.register We are http://127.0.0.1:55024/collection1/ and leader is http://127.0.0.1:55024/collection1/
[junit4] 2> 313704 T1210 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55024
[junit4] 2> 313704 T1210 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 313705 T1210 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 313705 T1210 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 313706 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 313707 T1185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 313708 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 313709 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 313713 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 313716 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 313717 T1214 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b0d9cd8 name:ZooKeeperConnection Watcher:127.0.0.1:38715/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 313718 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 313719 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 313721 T1185 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4] 2> 313789 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 313794 T1185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33117
[junit4] 2> 313795 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 313795 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 313796 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1374382784134
[junit4] 2> 313797 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1374382784134/'
[junit4] 2> 313805 T1185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1374382784134/solr.xml
[junit4] 2> 313836 T1185 oasc.CoreContainer.<init> New CoreContainer -1458396763
[junit4] 2> 313836 T1185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1374382784134/]
[junit4] 2> 313838 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 313838 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 313839 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 313840 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 313840 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 313841 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 313841 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 313842 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 313843 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 313843 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 313848 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 313849 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38715/solr
[junit4] 2> 313849 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 313852 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 313853 T1225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d34318b6 name:ZooKeeperConnection Watcher:127.0.0.1:38715 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 313853 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 313855 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 313862 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 313863 T1227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a098cb9e name:ZooKeeperConnection Watcher:127.0.0.1:38715/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 313863 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 313866 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 314869 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33117_
[junit4] 2> 314872 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33117_
[junit4] 2> 314876 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 314876 T1214 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 314876 T1227 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 314878 T1207 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 314886 T1228 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 314887 T1228 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 314889 T1228 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 315166 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 315168 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55024",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:55024_",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 315173 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:33117",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:33117_",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1"}
[junit4] 2> 315174 T1208 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4] 2> 315175 T1208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 315181 T1214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 315181 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 315181 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 315890 T1228 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 315891 T1228 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1374382784134/collection1
[junit4] 2> 315892 T1228 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 315894 T1228 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 315894 T1228 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 315897 T1228 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1374382784134/collection1/'
[junit4] 2> 315898 T1228 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1374382784134/collection1/lib/README' to classloader
[junit4] 2> 315900 T1228 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1374382784134/collection1/lib/classes/' to classloader
[junit4] 2> 315955 T1228 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 315991 T1228 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 315993 T1228 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 315999 T1228 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 316312 T1228 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 316318 T1228 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 316321 T1228 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 316334 T1228 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 316339 T1228 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 316343 T1228 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 316344 T1228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 316345 T1228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 316345 T1228 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 316346 T1228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 316347 T1228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 316347 T1228 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 316347 T1228 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1374382784134/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty1/
[junit4] 2> 316348 T1228 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3f082ac
[junit4] 2> 316349 T1228 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty1
[junit4] 2> 316349 T1228 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty1/index/
[junit4] 2> 316350 T1228 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 316350 T1228 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty1/index
[junit4] 2> 316351 T1228 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d5c6c51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@afc68e),segFN=segments_1,generation=1}
[junit4] 2> 316352 T1228 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 316354 T1228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 316355 T1228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 316356 T1228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 316356 T1228 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 316357 T1228 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 316357 T1228 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 316357 T1228 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 316358 T1228 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 316358 T1228 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 316360 T1228 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 316362 T1228 oass.SolrIndexSearcher.<init> Opening Searcher@47bd9651 main
[junit4] 2> 316363 T1228 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 316363 T1228 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 316368 T1229 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@47bd9651 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 316371 T1228 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 316372 T1228 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33117 collection:collection1 shard:shard1
[junit4] 2> 316373 T1228 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 316383 T1228 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 316394 T1228 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 316398 T1228 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 316399 T1228 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 316400 T1228 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33117/collection1/
[junit4] 2> 316401 T1228 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 316402 T1228 oasc.SyncStrategy.syncToMe http://127.0.0.1:33117/collection1/ has no replicas
[junit4] 2> 316403 T1228 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33117/collection1/ shard1
[junit4] 2> 316404 T1228 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 316691 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 316703 T1214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 316703 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 316703 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 316713 T1228 oasc.ZkController.register We are http://127.0.0.1:33117/collection1/ and leader is http://127.0.0.1:33117/collection1/
[junit4] 2> 316714 T1228 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33117
[junit4] 2> 316715 T1228 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 316716 T1228 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 316716 T1228 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 316719 T1228 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 316721 T1185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 316723 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 316724 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 316807 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 316812 T1185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47682
[junit4] 2> 316813 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 316814 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 316815 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1374382787146
[junit4] 2> 316815 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1374382787146/'
[junit4] 2> 316824 T1185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1374382787146/solr.xml
[junit4] 2> 316855 T1185 oasc.CoreContainer.<init> New CoreContainer -1417683006
[junit4] 2> 316855 T1185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1374382787146/]
[junit4] 2> 316857 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 316857 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 316858 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 316859 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 316859 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 316860 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 316860 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 316861 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 316862 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 316862 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 316867 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 316868 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38715/solr
[junit4] 2> 316868 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 316871 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 316872 T1241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a2bd7e71 name:ZooKeeperConnection Watcher:127.0.0.1:38715 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 316873 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 316874 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 316881 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 316883 T1243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1607de57 name:ZooKeeperConnection Watcher:127.0.0.1:38715/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 316884 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 316888 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 317891 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47682_
[junit4] 2> 317894 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47682_
[junit4] 2> 317898 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 317899 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 317899 T1214 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 317899 T1243 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 317900 T1214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 317902 T1207 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 317902 T1227 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 317911 T1244 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 317912 T1244 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 317914 T1244 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 318212 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 318215 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:33117",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:33117_",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 318221 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:47682",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "node_name":"127.0.0.1:47682_",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1"}
[junit4] 2> 318222 T1208 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 318223 T1208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 318229 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 318229 T1214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 318229 T1243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 318229 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 318915 T1244 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 318916 T1244 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1374382787146/collection1
[junit4] 2> 318917 T1244 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 318918 T1244 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 318919 T1244 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 318922 T1244 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1374382787146/collection1/'
[junit4] 2> 318923 T1244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1374382787146/collection1/lib/README' to classloader
[junit4] 2> 318924 T1244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1374382787146/collection1/lib/classes/' to classloader
[junit4] 2> 318972 T1244 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 319019 T1244 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 319021 T1244 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 319028 T1244 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 319388 T1244 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 319394 T1244 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 319396 T1244 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 319406 T1244 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 319411 T1244 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 319416 T1244 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 319417 T1244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 319417 T1244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 319418 T1244 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 319419 T1244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 319420 T1244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 319420 T1244 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 319421 T1244 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1374382787146/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty2/
[junit4] 2> 319421 T1244 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3f082ac
[junit4] 2> 319422 T1244 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty2
[junit4] 2> 319423 T1244 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty2/index/
[junit4] 2> 319423 T1244 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 319424 T1244 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty2/index
[junit4] 2> 319425 T1244 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ec67f920 lockFactory=org.apache.lucene.store.NativeFSLockFactory@535448fe),segFN=segments_1,generation=1}
[junit4] 2> 319426 T1244 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 319429 T1244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 319429 T1244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 319430 T1244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 319430 T1244 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 319431 T1244 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 319432 T1244 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 319432 T1244 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 319433 T1244 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 319433 T1244 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 319435 T1244 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 319437 T1244 oass.SolrIndexSearcher.<init> Opening Searcher@e081b2b main
[junit4] 2> 319438 T1244 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 319438 T1244 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 319442 T1245 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e081b2b main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 319444 T1244 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 319444 T1244 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47682 collection:collection1 shard:shard2
[junit4] 2> 319445 T1244 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 319451 T1244 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 319457 T1244 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 319458 T1244 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 319459 T1244 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 319459 T1244 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47682/collection1/
[junit4] 2> 319459 T1244 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 319460 T1244 oasc.SyncStrategy.syncToMe http://127.0.0.1:47682/collection1/ has no replicas
[junit4] 2> 319460 T1244 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47682/collection1/ shard2
[junit4] 2> 319461 T1244 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 319738 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 319749 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 319749 T1214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 319749 T1243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 319749 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 319766 T1244 oasc.ZkController.register We are http://127.0.0.1:47682/collection1/ and leader is http://127.0.0.1:47682/collection1/
[junit4] 2> 319767 T1244 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47682
[junit4] 2> 319768 T1244 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 319768 T1244 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 319769 T1244 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 319772 T1244 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 319774 T1185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 319775 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 319777 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 319873 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 319878 T1185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38342
[junit4] 2> 319878 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 319879 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 319880 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1374382790201
[junit4] 2> 319881 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1374382790201/'
[junit4] 2> 319891 T1185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1374382790201/solr.xml
[junit4] 2> 319926 T1185 oasc.CoreContainer.<init> New CoreContainer -1621680937
[junit4] 2> 319927 T1185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1374382790201/]
[junit4] 2> 319928 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 319929 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 319930 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 319931 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 319931 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 319932 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 319933 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 319933 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 319934 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 319935 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 319940 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 319941 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38715/solr
[junit4] 2> 319941 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 319944 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 319945 T1257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37591b90 name:ZooKeeperConnection Watcher:127.0.0.1:38715 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 319946 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 319948 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 319955 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 319956 T1259 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f40c566 name:ZooKeeperConnection Watcher:127.0.0.1:38715/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 319956 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 319960 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 320964 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38342_
[junit4] 2> 320967 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38342_
[junit4] 2> 320971 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 320971 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 320972 T1214 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 320973 T1243 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 320974 T1214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 320974 T1243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 320974 T1259 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 320977 T1207 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 320977 T1227 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 320986 T1260 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 320987 T1260 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 320988 T1260 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 321259 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 321261 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:47682",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "node_name":"127.0.0.1:47682_",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection1"}
[junit4] 2> 321268 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:38342",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "node_name":"127.0.0.1:38342_",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1"}
[junit4] 2> 321269 T1208 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 321269 T1208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 321275 T1259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 321275 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 321275 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 321275 T1214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 321275 T1243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 321988 T1260 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 321989 T1260 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1374382790201/collection1
[junit4] 2> 321990 T1260 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 321991 T1260 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 321992 T1260 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 321994 T1260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1374382790201/collection1/'
[junit4] 2> 321996 T1260 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1374382790201/collection1/lib/README' to classloader
[junit4] 2> 321997 T1260 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1374382790201/collection1/lib/classes/' to classloader
[junit4] 2> 322038 T1260 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 322069 T1260 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 322071 T1260 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 322078 T1260 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 322410 T1260 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 322416 T1260 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 322418 T1260 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 322433 T1260 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 322438 T1260 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 322445 T1260 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 322447 T1260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 322448 T1260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 322448 T1260 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 322450 T1260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 322450 T1260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 322451 T1260 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 322451 T1260 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1374382790201/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty3/
[junit4] 2> 322452 T1260 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3f082ac
[junit4] 2> 322453 T1260 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty3
[junit4] 2> 322453 T1260 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty3/index/
[junit4] 2> 322454 T1260 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 322454 T1260 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1374382780592/jetty3/index
[junit4] 2> 322456 T1260 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c98f4104 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fc2788b),segFN=segments_1,generation=1}
[junit4] 2> 322456 T1260 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 322459 T1260 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 322459 T1260 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 322460 T1260 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 322460 T1260 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 322461 T1260 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 322461 T1260 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 322462 T1260 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 322462 T1260 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 322463 T1260 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 322464 T1260 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 322466 T1260 oass.SolrIndexSearcher.<init> Opening Searcher@e84daba6 main
[junit4] 2> 322467 T1260 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 322468 T1260 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 322473 T1261 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e84daba6 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 322475 T1260 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 322475 T1260 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38342 collection:collection1 shard:shard1
[junit4] 2> 322476 T1260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 322485 T1260 oasc.ZkController.register We are http://127.0.0.1:38342/collection1/ and leader is http://127.0.0.1:33117/collection1/
[junit4] 2> 322486 T1260 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38342
[junit4] 2> 322486 T1260 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 322486 T1260 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C589 name=collection1 org.apache.solr.core.SolrCore@1072865d url=http://127.0.0.1:38342/collection1 node=127.0.0.1:38342_ C589_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:38342, state=down, node_name=127.0.0.1:38342_, core=collection1}
[junit4] 2> 322487 T1262 C589 P38342 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 322487 T1260 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 322487 T1262 C589 P38342 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 322488 T1262 C589 P38342 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4] 2> 322488 T1185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 322489 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 322488 T1262 C589 P38342 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 322490 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 322491 T1262 C589 P38342 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 322500 T1221 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 322572 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 322577 T1185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36277
[junit4] 2> 322577 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 322578 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 322579 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1374382792911
[junit4] 2> 322579 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1374382792911/'
[junit4] 2> 322588 T1185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1374382792911/solr.xml
[junit4] 2> 322618 T1185 oasc.CoreContainer.<init> New CoreContainer -1897572597
[junit4] 2> 322619 T1185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1374382792911/]
[junit4] 2> 322620 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 322621 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 322622 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 322622 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 322623 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 322623 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 322624 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 322625 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 322625 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 322626 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 322630 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 322631 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38715/solr
[junit4] 2> 322632 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 322634 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 322636 T1274 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@698401a2 name:ZooKeeperConnection Watcher:127.0.0.1:38715 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 322636 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 322637 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 322644 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 322645 T1276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16b55cc0 name:ZooKeeperConnection Watcher:127.0.0.1:38715/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 322645 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 322648 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 322782 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 322783 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:38342",
[junit4] 2> "state":"recovering",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "node_name":"127.0.0.1:38342_",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 322788 T1259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 322788 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 322788 T1243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 322788 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 322788 T1214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 322788 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 323502 T1221 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 323503 T1221 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=core_node3&wt=javabin&nodeName=127.0.0.1:38342_&core=collection1} status=0 QTime=1003
[junit4] 2> 323652 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36277_
[junit4] 2> 323655 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36277_
[junit4] 2> 323660 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 323660 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 323660 T1243 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 323661 T1259 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 323662 T1276 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 323663 T1259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 323661 T1214 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 323664 T1227 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 323664 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 323665 T1214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 323664 T1207 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4]
[...truncated too long message...]
"node_name":"127.0.0.1:47682_",
[junit4] 1> "core":"collection1"}
[junit4] 1> /solr/collections/collection1/shards (0)
[junit4] 1> /solr/collections/onenodecollection (2)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "router":"compositeId",
[junit4] 1> "configName":"conf1"}
[junit4] 1> /solr/collections/onenodecollection/leader_elect (1)
[junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election/90071549909270534-core_node1-n_0000000000 (0)
[junit4] 1> /solr/collections/onenodecollection/leaders (1)
[junit4] 1> /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "base_url":"http://127.0.0.1:33117",
[junit4] 1> "node_name":"127.0.0.1:33117_",
[junit4] 1> "core":"onenodecollectioncore"}
[junit4] 1> /solr/aliases.json (0)
[junit4] 1> /solr/live_nodes (5)
[junit4] 1> /solr/live_nodes/127.0.0.1:38342_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:55024_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:36277_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:33117_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:47682_ (0)
[junit4] 1> /solr/clusterstate.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "control_collection":{
[junit4] 1> "shards":{"shard1":{
[junit4] 1> "range":"80000000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{"core_node1":{
[junit4] 1> "base_url":"http://127.0.0.1:55024",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:55024_",
[junit4] 1> "core":"collection1",
[junit4] 1> "leader":"true"}}}},
[junit4] 1> "router":"compositeId"},
[junit4] 1> "onenodecollection":{
[junit4] 1> "shards":{"shard1":{
[junit4] 1> "range":"80000000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{"core_node1":{
[junit4] 1> "base_url":"http://127.0.0.1:33117",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:33117_",
[junit4] 1> "roles":"none",
[junit4] 1> "core":"onenodecollectioncore",
[junit4] 1> "leader":"true"}}}},
[junit4] 1> "router":"compositeId"},
[junit4] 1> "collection1":{
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-ffffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "base_url":"http://127.0.0.1:33117",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:33117_",
[junit4] 1> "core":"collection1",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node3":{
[junit4] 1> "base_url":"http://127.0.0.1:38342",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:38342_",
[junit4] 1> "core":"collection1"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"0-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "base_url":"http://127.0.0.1:47682",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:47682_",
[junit4] 1> "core":"collection1",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node4":{
[junit4] 1> "base_url":"http://127.0.0.1:36277",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:36277_",
[junit4] 1> "core":"collection1"}}}},
[junit4] 1> "router":"compositeId"}}
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=AFA56F7EE0081BA9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs_CZ_PREEURO -Dtests.timezone=America/Inuvik -Dtests.file.encoding=UTF-8
[junit4] ERROR 27.8s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:47682/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
[junit4] > at __randomizedtesting.SeedInfo.seed([AFA56F7EE0081BA9:2E43E16697577B95]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
[junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:780)
[junit4] 2> 338018 T1185 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 27849 T1184 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4] 2> 338117 T1259 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 338117 T1259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 338118 T1259 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 339225 T1276 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 339225 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 339226 T1276 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=cs_CZ_PREEURO, timezone=America/Inuvik
[junit4] 2> NOTE: Linux 3.2.0-49-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=1,free=47440696,total=169607168
[junit4] 2> NOTE: All tests run in this JVM: [TestFoldingMultitermQuery, TestSolr4Spatial, TestDistributedSearch, OpenExchangeRatesOrgProviderTest, TestReloadAndDeleteDocs, ShardRoutingCustomTest, URLClassifyProcessorTest, DebugComponentTest, DirectSolrSpellCheckerTest, TestFastOutputStream, SortByFunctionTest, TestLazyCores, SolrRequestParserTest, SuggesterTSTTest, DeleteShardTest, PathHierarchyTokenizerFactoryTest, TestJmxMonitoredMap, DocumentAnalysisRequestHandlerTest, TestBinaryField, TestMultiCoreConfBootstrap, TestStressReorder, SpellCheckComponentTest, SampleTest, InfoHandlerTest, TestFiltering, TestDFRSimilarityFactory, HdfsRecoveryZkTest, TestJmxIntegration, TestManagedSchemaFieldResource, TestSystemIdResolver, TestStressLucene, TestHashPartitioner, ChaosMonkeySafeLeaderTest, RequiredFieldsTest, StatsComponentTest, BasicDistributedZk2Test]
[junit4] Completed on J1 in 29.13s, 1 test, 1 error <<< FAILURES!
[...truncated 776 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:389: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:382: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1247: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:890: There were test failures: 318 suites, 1342 tests, 1 error, 35 ignored (7 assumptions)
Total time: 42 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure