You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/06/19 00:45:43 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_60) - Build #
10595 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10595/
Java: 32bit/jdk1.7.0_60 -server -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
at __randomizedtesting.SeedInfo.seed([41F7C1CE854E0FC9:C0114FD6F2116FF5]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:659)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1141)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1110)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11328 lines...]
[junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/init-core-data-001
[junit4] 2> 1206955 T4831 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 1206955 T4831 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /cm_ywc/a
[junit4] 2> 1206958 T4831 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 1206959 T4831 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1206959 T4832 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1207059 T4831 oasc.ZkTestServer.run start zk server on port:52707
[junit4] 2> 1207060 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1212365 T4835 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 5304ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 1212368 T4838 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14b9eb8 name:ZooKeeperConnection Watcher:127.0.0.1:52707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1212368 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1212369 T4831 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1212409 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1212428 T4840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1baef83 name:ZooKeeperConnection Watcher:127.0.0.1:52707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1212429 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1212430 T4831 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1212468 T4831 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1212488 T4831 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1212508 T4831 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1212528 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1212529 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1212621 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1212621 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1212624 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1212625 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1212627 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1212627 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1212629 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1212629 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1212631 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1212631 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1212633 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1212633 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1212638 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1212639 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1212640 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1212640 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1212642 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1212642 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1212644 T4831 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1212644 T4831 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1212877 T4831 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1212880 T4831 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51469
[junit4] 2> 1212881 T4831 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1212881 T4831 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1212881 T4831 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-002
[junit4] 2> 1212882 T4831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-002/'
[junit4] 2> 1212894 T4831 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-002/solr.xml
[junit4] 2> 1212919 T4831 oasc.CoreContainer.<init> New CoreContainer 10438579
[junit4] 2> 1212919 T4831 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-002/]
[junit4] 2> 1212920 T4831 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1212920 T4831 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1212921 T4831 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1212921 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1212921 T4831 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1212922 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1212922 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1212922 T4831 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1212923 T4831 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1212923 T4831 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1212923 T4831 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1212924 T4831 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1212924 T4831 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52707/solr
[junit4] 2> 1212925 T4831 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1212925 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1212926 T4851 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11c6639 name:ZooKeeperConnection Watcher:127.0.0.1:52707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1212927 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1212930 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1212931 T4853 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f60420 name:ZooKeeperConnection Watcher:127.0.0.1:52707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1212932 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1212933 T4831 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1212935 T4831 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1212937 T4831 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1212938 T4831 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1212940 T4831 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1212942 T4831 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1212943 T4831 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51469_cm_ywc%2Fa
[junit4] 2> 1212944 T4831 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51469_cm_ywc%2Fa
[junit4] 2> 1213056 T4831 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1213059 T4831 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1213062 T4831 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51469_cm_ywc%2Fa
[junit4] 2> 1213063 T4831 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1213064 T4831 oasc.Overseer.start Overseer (id=91955581551706115-127.0.0.1:51469_cm_ywc%2Fa-n_0000000000) starting
[junit4] 2> 1213066 T4831 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1213072 T4855 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1213072 T4831 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1213075 T4831 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1213077 T4831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1213090 T4854 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1213093 T4856 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1213094 T4856 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1213095 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1213096 T4854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1213096 T4854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51469/cm_ywc/a",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51469_cm_ywc%2Fa",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1213096 T4854 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1213096 T4856 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1213097 T4854 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1213098 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1213099 T4853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1214097 T4856 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1214097 T4856 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1214099 T4856 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1214099 T4856 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1214101 T4856 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1214101 T4856 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-002/collection1/'
[junit4] 2> 1214102 T4856 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 1214102 T4856 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 1214103 T4856 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 1214137 T4856 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1214161 T4856 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1214163 T4856 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1214168 T4856 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1214392 T4856 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1214397 T4856 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1214398 T4856 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1214407 T4856 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1214409 T4856 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1214411 T4856 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1214412 T4856 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1214412 T4856 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1214413 T4856 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1214413 T4856 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1214413 T4856 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1214414 T4856 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1214414 T4856 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1214414 T4856 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/control/data/
[junit4] 2> 1214414 T4856 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee1fb
[junit4] 2> 1214415 T4856 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/control/data
[junit4] 2> 1214415 T4856 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/control/data/index/
[junit4] 2> 1214415 T4856 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1214416 T4856 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/control/data/index
[junit4] 2> 1214416 T4856 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=38.1650390625, floorSegmentMB=1.1396484375, forceMergeDeletesPctAllowed=1.0856414213264365, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.381248586048039
[junit4] 2> 1214416 T4856 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1e3c2e0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8c3835),segFN=segments_1,generation=1}
[junit4] 2> 1214417 T4856 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1214419 T4856 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1214420 T4856 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1214420 T4856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1214420 T4856 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1214421 T4856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1214421 T4856 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1214421 T4856 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1214421 T4856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1214422 T4856 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1214422 T4856 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1214422 T4856 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1214423 T4856 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1214423 T4856 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1214423 T4856 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1214424 T4856 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1214424 T4856 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1214424 T4856 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1214427 T4856 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1214429 T4856 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1214429 T4856 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1214430 T4856 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1214430 T4856 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1e3c2e0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8c3835),segFN=segments_1,generation=1}
[junit4] 2> 1214431 T4856 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1214431 T4856 oass.SolrIndexSearcher.<init> Opening Searcher@27ccc8[collection1] main
[junit4] 2> 1214431 T4856 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1214432 T4856 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1214432 T4856 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1214433 T4856 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1214433 T4856 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1214433 T4856 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1214434 T4856 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1214434 T4856 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1214434 T4856 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1214435 T4856 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1214437 T4857 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27ccc8[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1214438 T4856 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1214438 T4860 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51469/cm_ywc/a collection:control_collection shard:shard1
[junit4] 2> 1214439 T4831 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1214439 T4860 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1214439 T4831 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1214440 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1214441 T4862 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e0f03f name:ZooKeeperConnection Watcher:127.0.0.1:52707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1214442 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1214443 T4831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1214444 T4860 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1214445 T4831 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1214446 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1214446 T4860 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1214446 T4860 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1262 name=collection1 org.apache.solr.core.SolrCore@d88c9b url=http://127.0.0.1:51469/cm_ywc/a/collection1 node=127.0.0.1:51469_cm_ywc%2Fa C1262_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:51469/cm_ywc/a, core=collection1, node_name=127.0.0.1:51469_cm_ywc%2Fa}
[junit4] 2> 1214447 T4860 C1262 P51469 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51469/cm_ywc/a/collection1/
[junit4] 2> 1214447 T4854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1214447 T4860 C1262 P51469 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1214447 T4860 C1262 P51469 oasc.SyncStrategy.syncToMe http://127.0.0.1:51469/cm_ywc/a/collection1/ has no replicas
[junit4] 2> 1214447 T4860 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51469/cm_ywc/a/collection1/ shard1
[junit4] 2> 1214448 T4860 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1214449 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1214451 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1214453 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1214555 T4862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1214555 T4853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1214602 T4860 oasc.ZkController.register We are http://127.0.0.1:51469/cm_ywc/a/collection1/ and leader is http://127.0.0.1:51469/cm_ywc/a/collection1/
[junit4] 2> 1214602 T4860 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51469/cm_ywc/a
[junit4] 2> 1214602 T4860 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1214602 T4860 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1214603 T4860 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1214604 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1214604 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1214604 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1214604 T4860 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1214605 T4854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1214606 T4854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:51469/cm_ywc/a",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51469_cm_ywc%2Fa",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1214607 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1214674 T4831 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1214675 T4831 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1214677 T4831 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48438
[junit4] 2> 1214678 T4831 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1214678 T4831 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1214678 T4831 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-003
[junit4] 2> 1214679 T4831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-003/'
[junit4] 2> 1214693 T4831 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-003/solr.xml
[junit4] 2> 1214709 T4853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1214709 T4862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1214717 T4831 oasc.CoreContainer.<init> New CoreContainer 7354950
[junit4] 2> 1214718 T4831 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-003/]
[junit4] 2> 1214718 T4831 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1214719 T4831 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1214719 T4831 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1214719 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1214720 T4831 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1214720 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1214720 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1214721 T4831 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1214721 T4831 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1214721 T4831 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1214722 T4831 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1214722 T4831 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1214722 T4831 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52707/solr
[junit4] 2> 1214723 T4831 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1214723 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1214725 T4873 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e8a9 name:ZooKeeperConnection Watcher:127.0.0.1:52707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1214725 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1214728 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1214729 T4875 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38487f name:ZooKeeperConnection Watcher:127.0.0.1:52707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1214729 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1214737 T4831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1215740 T4831 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48438_cm_ywc%2Fa
[junit4] 2> 1215742 T4831 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48438_cm_ywc%2Fa
[junit4] 2> 1215755 T4876 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1215756 T4876 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1215757 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1215757 T4876 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1215758 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1215758 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1215761 T4854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1215761 T4854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48438/cm_ywc/a",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48438_cm_ywc%2Fa",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1215762 T4854 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 1215762 T4854 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1215765 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1215868 T4875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1215868 T4862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1215868 T4853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1216758 T4876 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1216759 T4876 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1216760 T4876 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1216760 T4876 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1216762 T4876 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1216762 T4876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-003/collection1/'
[junit4] 2> 1216763 T4876 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 1216764 T4876 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 1216764 T4876 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 1216818 T4876 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1216841 T4876 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1216843 T4876 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1216849 T4876 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1217031 T4876 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1217035 T4876 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1217037 T4876 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1217045 T4876 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1217048 T4876 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1217050 T4876 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1217050 T4876 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1217051 T4876 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1217051 T4876 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1217051 T4876 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1217052 T4876 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1217052 T4876 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1217052 T4876 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1217052 T4876 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty1/
[junit4] 2> 1217053 T4876 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee1fb
[junit4] 2> 1217053 T4876 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty1
[junit4] 2> 1217053 T4876 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty1/index/
[junit4] 2> 1217053 T4876 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1217054 T4876 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty1/index
[junit4] 2> 1217054 T4876 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=38.1650390625, floorSegmentMB=1.1396484375, forceMergeDeletesPctAllowed=1.0856414213264365, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.381248586048039
[junit4] 2> 1217055 T4876 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@a827ca lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4f83),segFN=segments_1,generation=1}
[junit4] 2> 1217055 T4876 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1217058 T4876 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1217058 T4876 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1217058 T4876 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1217058 T4876 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1217059 T4876 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1217059 T4876 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1217059 T4876 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1217059 T4876 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1217060 T4876 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1217060 T4876 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1217060 T4876 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1217061 T4876 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1217061 T4876 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1217061 T4876 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1217061 T4876 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1217062 T4876 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1217062 T4876 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1217064 T4876 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1217066 T4876 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1217066 T4876 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1217067 T4876 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1217067 T4876 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@a827ca lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4f83),segFN=segments_1,generation=1}
[junit4] 2> 1217067 T4876 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1217068 T4876 oass.SolrIndexSearcher.<init> Opening Searcher@1e598db[collection1] main
[junit4] 2> 1217068 T4876 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1217090 T4876 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1217091 T4876 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1217091 T4876 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1217091 T4876 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1217092 T4876 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1217092 T4876 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1217092 T4876 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1217092 T4876 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1217093 T4876 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1217095 T4877 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e598db[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1217097 T4876 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1217098 T4880 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48438/cm_ywc/a collection:collection1 shard:shard1
[junit4] 2> 1217098 T4831 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1217098 T4831 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1217099 T4880 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1217102 T4880 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1217103 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217104 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217104 T4880 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1217104 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217104 T4880 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1263 name=collection1 org.apache.solr.core.SolrCore@1757629 url=http://127.0.0.1:48438/cm_ywc/a/collection1 node=127.0.0.1:48438_cm_ywc%2Fa C1263_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:48438/cm_ywc/a, core=collection1, node_name=127.0.0.1:48438_cm_ywc%2Fa}
[junit4] 2> 1217104 T4880 C1263 P48438 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48438/cm_ywc/a/collection1/
[junit4] 2> 1217104 T4880 C1263 P48438 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1217105 T4854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1217105 T4880 C1263 P48438 oasc.SyncStrategy.syncToMe http://127.0.0.1:48438/cm_ywc/a/collection1/ has no replicas
[junit4] 2> 1217105 T4880 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48438/cm_ywc/a/collection1/ shard1
[junit4] 2> 1217105 T4880 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1217106 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217108 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217110 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217213 T4853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1217213 T4862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1217213 T4875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1217259 T4880 oasc.ZkController.register We are http://127.0.0.1:48438/cm_ywc/a/collection1/ and leader is http://127.0.0.1:48438/cm_ywc/a/collection1/
[junit4] 2> 1217259 T4880 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48438/cm_ywc/a
[junit4] 2> 1217259 T4880 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1217259 T4880 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1217260 T4880 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1217261 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217261 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217261 T4880 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1217261 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217262 T4854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1217262 T4854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:48438/cm_ywc/a",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48438_cm_ywc%2Fa",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1217264 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1217350 T4831 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1217350 T4831 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1217352 T4831 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34116
[junit4] 2> 1217353 T4831 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1217354 T4831 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1217354 T4831 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-004
[junit4] 2> 1217354 T4831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-004/'
[junit4] 2> 1217365 T4853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1217365 T4862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1217365 T4875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1217366 T4831 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-004/solr.xml
[junit4] 2> 1217391 T4831 oasc.CoreContainer.<init> New CoreContainer 9103900
[junit4] 2> 1217392 T4831 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-004/]
[junit4] 2> 1217392 T4831 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1217393 T4831 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1217393 T4831 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1217393 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1217394 T4831 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1217394 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1217394 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1217394 T4831 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1217395 T4831 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1217395 T4831 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1217396 T4831 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1217396 T4831 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1217396 T4831 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52707/solr
[junit4] 2> 1217397 T4831 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1217397 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1217400 T4891 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ff351 name:ZooKeeperConnection Watcher:127.0.0.1:52707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1217400 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1217403 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1217404 T4893 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11b7e4b name:ZooKeeperConnection Watcher:127.0.0.1:52707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1217404 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1217411 T4831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1218414 T4831 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34116_cm_ywc%2Fa
[junit4] 2> 1218416 T4831 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34116_cm_ywc%2Fa
[junit4] 2> 1218434 T4894 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1218434 T4894 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1218436 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1218436 T4894 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1218436 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1218437 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1218439 T4854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1218440 T4854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34116/cm_ywc/a",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34116_cm_ywc%2Fa",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1218441 T4854 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 1218441 T4854 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1218444 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1218547 T4893 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1218547 T4875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1218547 T4862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1218547 T4853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1219437 T4894 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1219437 T4894 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1219439 T4894 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1219439 T4894 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1219441 T4894 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1219441 T4894 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-004/collection1/'
[junit4] 2> 1219442 T4894 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 1219442 T4894 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 1219443 T4894 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 1219497 T4894 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1219520 T4894 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1219521 T4894 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1219526 T4894 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1219711 T4894 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1219715 T4894 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1219717 T4894 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1219725 T4894 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1219728 T4894 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1219731 T4894 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1219731 T4894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1219732 T4894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1219732 T4894 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1219733 T4894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1219733 T4894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1219733 T4894 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1219733 T4894 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1219734 T4894 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty2/
[junit4] 2> 1219734 T4894 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee1fb
[junit4] 2> 1219735 T4894 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty2
[junit4] 2> 1219735 T4894 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty2/index/
[junit4] 2> 1219735 T4894 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1219736 T4894 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-001/jetty2/index
[junit4] 2> 1219736 T4894 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=38.1650390625, floorSegmentMB=1.1396484375, forceMergeDeletesPctAllowed=1.0856414213264365, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.381248586048039
[junit4] 2> 1219737 T4894 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@d31057 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1dbf6ae),segFN=segments_1,generation=1}
[junit4] 2> 1219737 T4894 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1219742 T4894 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1219743 T4894 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1219743 T4894 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1219744 T4894 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1219744 T4894 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1219744 T4894 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1219745 T4894 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1219745 T4894 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1219745 T4894 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1219746 T4894 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1219746 T4894 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1219747 T4894 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1219747 T4894 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1219748 T4894 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1219748 T4894 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1219749 T4894 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1219749 T4894 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1219753 T4894 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1219756 T4894 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1219756 T4894 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1219757 T4894 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1219758 T4894 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@d31057 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1dbf6ae),segFN=segments_1,generation=1}
[junit4] 2> 1219758 T4894 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1219758 T4894 oass.SolrIndexSearcher.<init> Opening Searcher@1667022[collection1] main
[junit4] 2> 1219758 T4894 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1219759 T4894 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1219760 T4894 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1219760 T4894 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1219760 T4894 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1219761 T4894 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1219761 T4894 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1219762 T4894 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1219762 T4894 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1219762 T4894 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1219765 T4895 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1667022[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1219767 T4894 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1219768 T4898 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34116/cm_ywc/a collection:collection1 shard:shard1
[junit4] 2> 1219768 T4831 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1219769 T4831 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1219772 T4898 oasc.ZkController.register We are http://127.0.0.1:34116/cm_ywc/a/collection1/ and leader is http://127.0.0.1:48438/cm_ywc/a/collection1/
[junit4] 2> 1219772 T4898 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34116/cm_ywc/a
[junit4] 2> 1219772 T4898 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 1219773 T4898 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C1264 name=collection1 org.apache.solr.core.SolrCore@151e3ce url=http://127.0.0.1:34116/cm_ywc/a/collection1 node=127.0.0.1:34116_cm_ywc%2Fa C1264_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:34116/cm_ywc/a, core=collection1, node_name=127.0.0.1:34116_cm_ywc%2Fa}
[junit4] 2> 1219773 T4899 C1264 P34116 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 1219774 T4899 C1264 P34116 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 1219774 T4898 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1219774 T4899 C1264 P34116 oasc.RecoveryStrategy.doRecovery Publishing state of core collection1 as recovering, leader is http://127.0.0.1:48438/cm_ywc/a/collection1/ and I am http://127.0.0.1:34116/cm_ywc/a/collection1/
[junit4] 2> 1219774 T4899 C1264 P34116 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 1219774 T4899 C1264 P34116 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1219776 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1219776 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1219776 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1219777 T4899 C1264 P34116 oasc.RecoveryStrategy.sendPrepRecoveryCmd Sending prep recovery command to http://127.0.0.1:48438/cm_ywc/a; WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1%3A34116_cm_ywc%252Fa&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true
[junit4] 2> 1219777 T4854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1219778 T4871 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 1219778 T4854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "base_url":"http://127.0.0.1:34116/cm_ywc/a",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34116_cm_ywc%2Fa",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1219779 T4871 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1219780 T4871 oasha.CoreAdminHandler.handleWaitForStateAction Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 1219780 T4871 oasha.CoreAdminHandler.handleWaitForStateAction In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:34116_cm_ywc%2Fa, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"state":"down","base_url":"http://127.0.0.1:34116/cm_ywc/a","core":"collection1","node_name":"127.0.0.1:34116_cm_ywc%2Fa"}
[junit4] 2> 1219781 T4853 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1219884 T4875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1219884 T4862 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1219884 T4893 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1219884 T4853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1220012 T4831 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1220013 T4831 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1220014 T4831 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53404
[junit4] 2> 1220016 T4831 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1220016 T4831 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1220016 T4831 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-005
[junit4] 2> 1220017 T4831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-005/'
[junit4] 2> 1220028 T4831 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-005/solr.xml
[junit4] 2> 1220054 T4831 oasc.CoreContainer.<init> New CoreContainer 5887373
[junit4] 2> 1220055 T4831 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001/tempDir-005/]
[junit4] 2> 1220055 T4831 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1220056 T4831 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1220056 T4831 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1220056 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1220056 T4831 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1220057 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1220057 T4831 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1220057 T4831 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1220058 T4831 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1220058 T4831 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1220059 T4831 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1220059 T4831 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1220059 T4831 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52707/solr
[junit4] 2> 1220059 T4831 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1220060 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1220062 T4911 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d33e03 name:ZooKeeperConnection Watcher:127.0.0.1:52707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1220063 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1220066 T4831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1220067 T4913 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a1316d name:ZooKeeperConnection Watcher:127.0.0.1:52707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1220068 T4831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1220079 T4831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1220781 T4871 oasha.CoreAdminHandler.handleWaitForStateAction In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:34116_cm_ywc%2Fa, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"state":"recovering","base_url":"http://127.0.0.1:34116/cm_ywc/a","core":"collection1","node_name":"127.0.0.1:34116_cm_ywc%2Fa"}
[junit4] 2> 1220782 T4871 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 1220782 T4871 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&checkLive=true&onlyIfLeaderActive=true&onlyIfLeader=true&coreNodeName=core_node2&action=PREPRECOVERY&wt=javabin&nodeName=127.0.0.1:34116_cm_ywc%252Fa&core=collection1&version=2} status=0 QTime=1004
[junit4] 2> 1221084 T4831 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127
[...truncated too long message...]
001/tempDir-001/jetty4/index
[junit4] 2> 1268119 T4934 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:243)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:346)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:330)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:194)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:313)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:448)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:212)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:313)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:448)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:212)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:313)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:448)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:212)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:357)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1268121 T4934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1268121 T4934 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1268122 T4934 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1268122 T4934 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:357)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.SyncSliceTest-41F7C1CE854E0FC9-001
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=sq_AL, timezone=America/St_Kitts
[junit4] 2> NOTE: Linux 3.8.0-41-generic i386/Oracle Corporation 1.7.0_60 (32-bit)/cpus=8,threads=1,free=312875712,total=529530880
[junit4] 2> NOTE: All tests run in this JVM: [HardAutoCommitTest, AnalyticsMergeStrategyTest, TestSolrCoreProperties, ResourceLoaderTest, HighlighterMaxOffsetTest, DeleteInactiveReplicaTest, TestDistributedGrouping, TestRangeQuery, CoreContainerCoreInitFailuresTest, CoreAdminRequestStatusTest, TestInfoStreamLogging, StandardRequestHandlerTest, TestSolrXMLSerializer, DocumentAnalysisRequestHandlerTest, TestNonNRTOpen, ShardRoutingCustomTest, TestReload, SimplePostToolTest, FullSolrCloudDistribCmdsTest, DistributedDebugComponentTest, TestFuzzyAnalyzedSuggestions, TestJmxIntegration, IndexBasedSpellCheckerTest, DateMathParserTest, AddBlockUpdateTest, TestUniqueKeyFieldResource, PingRequestHandlerTest, DocValuesMultiTest, DistributedQueryComponentOptimizationTest, TestIBSimilarityFactory, DateRangeFieldTest, InfoHandlerTest, TestLRUCache, DistribDocExpirationUpdateProcessorTest, ShardSplitTest, IndexSchemaRuntimeFieldTest, HdfsChaosMonkeySafeLeaderTest, TestMultiCoreConfBootstrap, TestSolrDeletionPolicy2, TestCSVLoader, TestIndexSearcher, TestCollectionAPI, TestPartialUpdateDeduplication, TestSweetSpotSimilarityFactory, OpenExchangeRatesOrgProviderTest, TestComponentsName, TestManagedSchemaFieldResource, HdfsDirectoryTest, TestSolrQueryParserResource, DistributedQueryComponentCustomSortTest, TestSerializedLuceneMatchVersion, SSLMigrationTest, SolrCmdDistributorTest, TestSolrXmlPersistence, CachingDirectoryFactoryTest, PluginInfoTest, TestCoreDiscovery, SystemInfoHandlerTest, NumericFieldsTest, TestPhraseSuggestions, DisMaxRequestHandlerTest, DateFieldTest, TestSolr4Spatial, TestFieldTypeCollectionResource, HighlighterTest, TestFieldSortValues, DistanceFunctionTest, LegacyHTMLStripCharFilterTest, TestStressUserVersions, TestModifyConfFiles, FunctionTest, TestFastWriter, TestSolrQueryParserDefaultOperatorResource, LeaderElectionIntegrationTest, PathHierarchyTokenizerFactoryTest, TestHighFrequencyDictionaryFactory, TestCloudManagedSchemaConcurrent, HighlighterConfigTest, TestClassNameShortening, AsyncMigrateRouteKeyTest, TestRTGBase, SolrRequestParserTest, TestStressReorder, PrimUtilsTest, MinimalSchemaTest, HdfsCollectionsAPIDistributedZkTest, NotRequiredUniqueKeyTest, TestChildDocTransformer, CoreMergeIndexesAdminHandlerTest, TestDistributedSearch, TestSchemaSimilarityResource, StatsComponentTest, SuggesterWFSTTest, DirectUpdateHandlerTest, ResponseHeaderTest, SpellCheckCollatorTest, HdfsWriteToMultipleCollectionsTest, TestStressRecovery, AddSchemaFieldsUpdateProcessorFactoryTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, SyncSliceTest]
[junit4] Completed on J1 in 61.38s, 1 test, 1 error <<< FAILURES!
[...truncated 647 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 415 suites, 1703 tests, 1 error, 36 ignored (15 assumptions)
Total time: 68 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_05) - Build #
10598 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10598/
Java: 32bit/jdk1.8.0_05 -client -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
at __randomizedtesting.SeedInfo.seed([410B5CBC4960987A:C0EDD2A43E3FF846]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:659)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1141)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1110)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11295 lines...]
[junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/init-core-data-001
[junit4] 2> 803662 T3601 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 803663 T3601 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /qub/e
[junit4] 2> 803666 T3601 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 803666 T3601 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 803667 T3602 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 803767 T3601 oasc.ZkTestServer.run start zk server on port:58258
[junit4] 2> 803768 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 809313 T3605 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 5543ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 809315 T3608 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@86d8a3 name:ZooKeeperConnection Watcher:127.0.0.1:58258 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 809315 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 809316 T3601 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 809323 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 809324 T3610 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a5d497 name:ZooKeeperConnection Watcher:127.0.0.1:58258/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 809325 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 809326 T3601 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 809329 T3601 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 809333 T3601 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 809337 T3601 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 809341 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 809342 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 809349 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 809350 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 809355 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 809356 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 809360 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 809361 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 809365 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 809366 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 809370 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 809371 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 809374 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 809375 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 809378 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 809379 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 809380 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 809381 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 809383 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 809383 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 809385 T3601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 809385 T3601 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 809682 T3601 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 809688 T3601 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56100
[junit4] 2> 809689 T3601 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 809690 T3601 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 809690 T3601 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-002
[junit4] 2> 809691 T3601 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-002/'
[junit4] 2> 809707 T3601 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-002/solr.xml
[junit4] 2> 809715 T3601 oasc.CoreContainer.<init> New CoreContainer 15271200
[junit4] 2> 809716 T3601 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-002/]
[junit4] 2> 809716 T3601 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 809717 T3601 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 809717 T3601 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 809717 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 809718 T3601 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 809718 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 809718 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 809719 T3601 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 809719 T3601 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 809720 T3601 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 809720 T3601 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 809720 T3601 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 809721 T3601 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58258/solr
[junit4] 2> 809721 T3601 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 809722 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 809724 T3621 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17e7492 name:ZooKeeperConnection Watcher:127.0.0.1:58258 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 809724 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 809728 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 809729 T3623 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a25fa name:ZooKeeperConnection Watcher:127.0.0.1:58258/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 809730 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 809732 T3601 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 809737 T3601 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 809742 T3601 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 809747 T3601 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 809753 T3601 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 809759 T3601 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 809763 T3601 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56100_qub%2Fe
[junit4] 2> 809765 T3601 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56100_qub%2Fe
[junit4] 2> 809773 T3601 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 809776 T3601 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 809784 T3601 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56100_qub%2Fe
[junit4] 2> 809785 T3601 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 809789 T3601 oasc.Overseer.start Overseer (id=91957030752419843-127.0.0.1:56100_qub%2Fe-n_0000000000) starting
[junit4] 2> 809795 T3601 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 809811 T3625 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 809812 T3601 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 809815 T3601 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 809818 T3601 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 809821 T3624 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 809824 T3626 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 809825 T3626 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 809826 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 809827 T3626 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 809828 T3624 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 809830 T3624 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56100/qub/e",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56100_qub%2Fe",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 809830 T3624 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 809830 T3624 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 809834 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 809835 T3623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 810827 T3626 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 810828 T3626 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 810829 T3626 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 810830 T3626 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 810831 T3626 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 810832 T3626 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-002/collection1/'
[junit4] 2> 810833 T3626 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 810833 T3626 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 810834 T3626 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 810875 T3626 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 810900 T3626 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 810901 T3626 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 810910 T3626 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 811027 T3626 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 811031 T3626 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 811033 T3626 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 811041 T3626 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 811043 T3626 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 811045 T3626 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 811046 T3626 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 811046 T3626 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 811046 T3626 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 811047 T3626 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 811047 T3626 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 811048 T3626 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 811048 T3626 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 811048 T3626 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/control/data/
[junit4] 2> 811048 T3626 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d75d35
[junit4] 2> 811049 T3626 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/control/data
[junit4] 2> 811049 T3626 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/control/data/index/
[junit4] 2> 811049 T3626 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 811050 T3626 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/control/data/index
[junit4] 2> 811050 T3626 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=58.228515625, floorSegmentMB=1.0302734375, forceMergeDeletesPctAllowed=2.3046588050131755, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.13484273347697143
[junit4] 2> 811050 T3626 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@e1a7cd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6d3630),segFN=segments_1,generation=1}
[junit4] 2> 811051 T3626 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 811054 T3626 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 811055 T3626 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 811055 T3626 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 811056 T3626 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 811056 T3626 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 811057 T3626 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 811057 T3626 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 811057 T3626 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 811057 T3626 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 811058 T3626 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 811058 T3626 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 811058 T3626 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 811059 T3626 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 811059 T3626 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 811059 T3626 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 811060 T3626 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 811060 T3626 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 811062 T3626 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 811063 T3626 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 811063 T3626 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 811064 T3626 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=14.3876953125, floorSegmentMB=0.62890625, forceMergeDeletesPctAllowed=20.94711124889076, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6113060518138527
[junit4] 2> 811064 T3626 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@e1a7cd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6d3630),segFN=segments_1,generation=1}
[junit4] 2> 811065 T3626 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 811065 T3626 oass.SolrIndexSearcher.<init> Opening Searcher@16bb39e[collection1] main
[junit4] 2> 811065 T3626 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 811066 T3626 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 811067 T3626 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 811067 T3626 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 811067 T3626 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 811067 T3626 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 811068 T3626 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 811068 T3626 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 811068 T3626 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 811069 T3626 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 811071 T3627 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16bb39e[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 811072 T3626 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 811073 T3630 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56100/qub/e collection:control_collection shard:shard1
[junit4] 2> 811074 T3601 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 811074 T3601 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 811075 T3630 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 811076 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 811077 T3632 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14f98c name:ZooKeeperConnection Watcher:127.0.0.1:58258/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 811077 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 811079 T3601 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 811082 T3601 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 811082 T3630 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 811084 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 811085 T3630 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 811085 T3630 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1321 name=collection1 org.apache.solr.core.SolrCore@7923d4 url=http://127.0.0.1:56100/qub/e/collection1 node=127.0.0.1:56100_qub%2Fe C1321_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:56100/qub/e, core=collection1, node_name=127.0.0.1:56100_qub%2Fe}
[junit4] 2> 811085 T3630 C1321 P56100 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56100/qub/e/collection1/
[junit4] 2> 811086 T3630 C1321 P56100 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 811086 T3630 C1321 P56100 oasc.SyncStrategy.syncToMe http://127.0.0.1:56100/qub/e/collection1/ has no replicas
[junit4] 2> 811086 T3624 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 811086 T3630 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56100/qub/e/collection1/ shard1
[junit4] 2> 811087 T3630 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 811090 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 811097 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 811099 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 811201 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 811201 T3623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 811248 T3630 oasc.ZkController.register We are http://127.0.0.1:56100/qub/e/collection1/ and leader is http://127.0.0.1:56100/qub/e/collection1/
[junit4] 2> 811249 T3630 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56100/qub/e
[junit4] 2> 811249 T3630 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 811249 T3630 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 811249 T3630 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 811250 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 811251 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 811251 T3630 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 811251 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 811252 T3624 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 811253 T3624 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:56100/qub/e",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56100_qub%2Fe",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 811255 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 811352 T3601 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 811353 T3601 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 811355 T3601 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51088
[junit4] 2> 811356 T3601 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 811356 T3623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 811356 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 811357 T3601 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 811358 T3601 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-003
[junit4] 2> 811358 T3601 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-003/'
[junit4] 2> 811372 T3601 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-003/solr.xml
[junit4] 2> 811380 T3601 oasc.CoreContainer.<init> New CoreContainer 16225722
[junit4] 2> 811381 T3601 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-003/]
[junit4] 2> 811381 T3601 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 811382 T3601 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 811382 T3601 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 811382 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 811382 T3601 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 811383 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 811383 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 811383 T3601 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 811384 T3601 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 811384 T3601 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 811385 T3601 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 811385 T3601 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 811385 T3601 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58258/solr
[junit4] 2> 811386 T3601 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 811387 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 811389 T3643 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a4ec4e name:ZooKeeperConnection Watcher:127.0.0.1:58258 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 811390 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 811393 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 811394 T3645 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@192e7ca name:ZooKeeperConnection Watcher:127.0.0.1:58258/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 811395 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 811405 T3601 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 812410 T3601 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51088_qub%2Fe
[junit4] 2> 812412 T3601 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51088_qub%2Fe
[junit4] 2> 812442 T3646 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 812442 T3646 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 812443 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 812443 T3646 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 812444 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 812445 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 812447 T3624 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 812448 T3624 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51088/qub/e",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51088_qub%2Fe",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 812448 T3624 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 812448 T3624 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 812450 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 812553 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 812553 T3645 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 812553 T3623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 813445 T3646 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 813445 T3646 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 813446 T3646 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 813447 T3646 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 813448 T3646 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 813448 T3646 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-003/collection1/'
[junit4] 2> 813450 T3646 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 813450 T3646 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 813451 T3646 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 813475 T3646 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 813485 T3646 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 813486 T3646 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 813491 T3646 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 813616 T3646 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 813620 T3646 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 813622 T3646 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 813629 T3646 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 813631 T3646 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 813633 T3646 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 813634 T3646 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 813634 T3646 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 813634 T3646 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 813635 T3646 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 813635 T3646 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 813635 T3646 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 813635 T3646 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 813636 T3646 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty1/
[junit4] 2> 813636 T3646 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d75d35
[junit4] 2> 813637 T3646 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty1
[junit4] 2> 813637 T3646 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty1/index/
[junit4] 2> 813637 T3646 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 813638 T3646 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty1/index
[junit4] 2> 813639 T3646 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=58.228515625, floorSegmentMB=1.0302734375, forceMergeDeletesPctAllowed=2.3046588050131755, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.13484273347697143
[junit4] 2> 813639 T3646 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@a6927d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1d22c8b),segFN=segments_1,generation=1}
[junit4] 2> 813640 T3646 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 813643 T3646 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 813644 T3646 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 813644 T3646 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 813644 T3646 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 813645 T3646 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 813645 T3646 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 813645 T3646 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 813646 T3646 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 813646 T3646 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 813647 T3646 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 813647 T3646 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 813647 T3646 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 813648 T3646 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 813648 T3646 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 813649 T3646 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 813650 T3646 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 813650 T3646 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 813652 T3646 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 813654 T3646 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 813654 T3646 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 813655 T3646 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=14.3876953125, floorSegmentMB=0.62890625, forceMergeDeletesPctAllowed=20.94711124889076, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6113060518138527
[junit4] 2> 813655 T3646 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@a6927d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1d22c8b),segFN=segments_1,generation=1}
[junit4] 2> 813656 T3646 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 813656 T3646 oass.SolrIndexSearcher.<init> Opening Searcher@1aaceb3[collection1] main
[junit4] 2> 813656 T3646 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 813657 T3646 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 813657 T3646 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 813658 T3646 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 813658 T3646 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 813658 T3646 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 813659 T3646 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 813659 T3646 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 813659 T3646 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 813659 T3646 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 813663 T3647 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1aaceb3[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 813666 T3646 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 813667 T3650 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51088/qub/e collection:collection1 shard:shard1
[junit4] 2> 813667 T3601 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 813668 T3601 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 813668 T3650 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 813674 T3650 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 813676 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813676 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813677 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813676 T3650 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 813677 T3650 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1322 name=collection1 org.apache.solr.core.SolrCore@e688d7 url=http://127.0.0.1:51088/qub/e/collection1 node=127.0.0.1:51088_qub%2Fe C1322_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:51088/qub/e, core=collection1, node_name=127.0.0.1:51088_qub%2Fe}
[junit4] 2> 813677 T3650 C1322 P51088 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51088/qub/e/collection1/
[junit4] 2> 813678 T3650 C1322 P51088 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 813678 T3624 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 813678 T3650 C1322 P51088 oasc.SyncStrategy.syncToMe http://127.0.0.1:51088/qub/e/collection1/ has no replicas
[junit4] 2> 813678 T3650 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51088/qub/e/collection1/ shard1
[junit4] 2> 813678 T3650 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 813680 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813682 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813684 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813786 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 813786 T3645 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 813786 T3623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 813833 T3650 oasc.ZkController.register We are http://127.0.0.1:51088/qub/e/collection1/ and leader is http://127.0.0.1:51088/qub/e/collection1/
[junit4] 2> 813833 T3650 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51088/qub/e
[junit4] 2> 813833 T3650 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 813833 T3650 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 813833 T3650 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 813835 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813836 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813836 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813836 T3650 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 813837 T3624 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 813837 T3624 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:51088/qub/e",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51088_qub%2Fe",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 813839 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 813941 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 813941 T3645 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 813941 T3623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 813975 T3601 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 813976 T3601 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 813978 T3601 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:42480
[junit4] 2> 813979 T3601 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 813979 T3601 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 813980 T3601 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-004
[junit4] 2> 813980 T3601 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-004/'
[junit4] 2> 814000 T3601 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-004/solr.xml
[junit4] 2> 814008 T3601 oasc.CoreContainer.<init> New CoreContainer 22758882
[junit4] 2> 814009 T3601 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-004/]
[junit4] 2> 814009 T3601 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 814009 T3601 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 814010 T3601 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 814010 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 814010 T3601 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 814011 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 814011 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 814011 T3601 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 814012 T3601 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 814012 T3601 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 814012 T3601 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 814013 T3601 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 814013 T3601 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58258/solr
[junit4] 2> 814013 T3601 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 814014 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 814016 T3661 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b53fb name:ZooKeeperConnection Watcher:127.0.0.1:58258 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 814016 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 814019 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 814020 T3663 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f78a41 name:ZooKeeperConnection Watcher:127.0.0.1:58258/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 814020 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 814029 T3601 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 815033 T3601 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42480_qub%2Fe
[junit4] 2> 815035 T3601 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42480_qub%2Fe
[junit4] 2> 815049 T3664 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 815049 T3664 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 815051 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 815052 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 815051 T3664 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 815052 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 815054 T3624 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 815055 T3624 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42480/qub/e",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:42480_qub%2Fe",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 815056 T3624 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 815056 T3624 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 815059 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 815163 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 815163 T3645 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 815163 T3663 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 815163 T3623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 816053 T3664 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 816053 T3664 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 816054 T3664 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 816054 T3664 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 816055 T3664 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 816056 T3664 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-004/collection1/'
[junit4] 2> 816056 T3664 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 816057 T3664 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 816057 T3664 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 816082 T3664 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 816108 T3664 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 816109 T3664 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 816119 T3664 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 816243 T3664 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 816246 T3664 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 816248 T3664 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 816259 T3664 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 816262 T3664 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 816266 T3664 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 816267 T3664 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 816267 T3664 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 816267 T3664 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 816268 T3664 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 816268 T3664 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 816269 T3664 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 816269 T3664 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 816271 T3664 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty2/
[junit4] 2> 816272 T3664 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1d75d35
[junit4] 2> 816273 T3664 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty2
[junit4] 2> 816273 T3664 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty2/index/
[junit4] 2> 816274 T3664 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 816274 T3664 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty2/index
[junit4] 2> 816275 T3664 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=58.228515625, floorSegmentMB=1.0302734375, forceMergeDeletesPctAllowed=2.3046588050131755, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.13484273347697143
[junit4] 2> 816276 T3664 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4fcb37 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d5dce7),segFN=segments_1,generation=1}
[junit4] 2> 816277 T3664 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 816280 T3664 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 816280 T3664 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 816280 T3664 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 816280 T3664 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 816281 T3664 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 816281 T3664 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 816281 T3664 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 816281 T3664 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 816282 T3664 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 816282 T3664 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 816283 T3664 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 816283 T3664 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 816283 T3664 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 816284 T3664 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 816284 T3664 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 816285 T3664 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 816285 T3664 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 816287 T3664 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 816288 T3664 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 816288 T3664 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 816289 T3664 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=14.3876953125, floorSegmentMB=0.62890625, forceMergeDeletesPctAllowed=20.94711124889076, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6113060518138527
[junit4] 2> 816289 T3664 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4fcb37 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d5dce7),segFN=segments_1,generation=1}
[junit4] 2> 816290 T3664 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 816290 T3664 oass.SolrIndexSearcher.<init> Opening Searcher@1d01cd7[collection1] main
[junit4] 2> 816290 T3664 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 816292 T3664 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 816292 T3664 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 816292 T3664 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 816293 T3664 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 816293 T3664 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 816294 T3664 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 816294 T3664 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 816294 T3664 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 816294 T3664 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 816298 T3665 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d01cd7[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 816301 T3664 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 816302 T3668 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:42480/qub/e collection:collection1 shard:shard1
[junit4] 2> 816303 T3601 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 816303 T3601 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 816304 T3668 oasc.ZkController.register We are http://127.0.0.1:42480/qub/e/collection1/ and leader is http://127.0.0.1:51088/qub/e/collection1/
[junit4] 2> 816305 T3668 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42480/qub/e
[junit4] 2> 816306 T3668 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 816306 T3668 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C1323 name=collection1 org.apache.solr.core.SolrCore@174e8c1 url=http://127.0.0.1:42480/qub/e/collection1 node=127.0.0.1:42480_qub%2Fe C1323_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:42480/qub/e, core=collection1, node_name=127.0.0.1:42480_qub%2Fe}
[junit4] 2> 816307 T3669 C1323 P42480 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 816308 T3669 C1323 P42480 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 816307 T3668 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 816308 T3669 C1323 P42480 oasc.RecoveryStrategy.doRecovery Publishing state of core collection1 as recovering, leader is http://127.0.0.1:51088/qub/e/collection1/ and I am http://127.0.0.1:42480/qub/e/collection1/
[junit4] 2> 816309 T3669 C1323 P42480 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 816309 T3669 C1323 P42480 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 816310 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 816311 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 816311 T3669 C1323 P42480 oasc.RecoveryStrategy.sendPrepRecoveryCmd Sending prep recovery command to http://127.0.0.1:51088/qub/e; WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1%3A42480_qub%252Fe&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true
[junit4] 2> 816311 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 816313 T3640 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 816314 T3624 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 816314 T3640 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 816315 T3624 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "base_url":"http://127.0.0.1:42480/qub/e",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:42480_qub%2Fe",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 816315 T3640 oasha.CoreAdminHandler.handleWaitForStateAction Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 816316 T3640 oasha.CoreAdminHandler.handleWaitForStateAction In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:42480_qub%2Fe, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"state":"down","base_url":"http://127.0.0.1:42480/qub/e","core":"collection1","node_name":"127.0.0.1:42480_qub%2Fe"}
[junit4] 2> 816318 T3623 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 816421 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 816421 T3645 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 816421 T3623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 816421 T3663 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 816575 T3601 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 816575 T3601 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 816578 T3601 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58836
[junit4] 2> 816579 T3601 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 816580 T3601 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 816581 T3601 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-005
[junit4] 2> 816582 T3601 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-005/'
[junit4] 2> 816604 T3601 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-005/solr.xml
[junit4] 2> 816636 T3601 oasc.CoreContainer.<init> New CoreContainer 29477648
[junit4] 2> 816637 T3601 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-005/]
[junit4] 2> 816637 T3601 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 816638 T3601 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 816638 T3601 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 816638 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 816639 T3601 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 816639 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 816639 T3601 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 816639 T3601 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 816640 T3601 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 816640 T3601 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 816641 T3601 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 816641 T3601 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 816642 T3601 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58258/solr
[junit4] 2> 816642 T3601 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 816643 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 816644 T3681 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ba6cd3 name:ZooKeeperConnection Watcher:127.0.0.1:58258 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 816645 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 816647 T3601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 816648 T3683 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d47070 name:ZooKeeperConnection Watcher:127.0.0.1:58258/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 816649 T3601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 816660 T3601 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 817317 T3640 oasha.CoreAdminHandler.handleWaitForStateAction In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:42480_qub%2Fe, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"state":"recovering","base_url":"http://127.0.0.1:42480/qub/e","core":"collection1","node_name":"127.0.0.1:42480_qub%2Fe"}
[junit4] 2> 817317 T3640 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 817318 T3640 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:42480_qub%252Fe&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node2&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1005
[junit4] 2> 817664 T3601 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58836_qub
[...truncated too long message...]
SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 867401 T3703 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 867402 T3703 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 867402 T3703 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 867402 T3703 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty4/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty4/index;done=false>>]
[junit4] 2> 867402 T3703 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty4/index
[junit4] 2> 867403 T3703 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty4 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty4;done=false>>]
[junit4] 2> 867403 T3703 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001/tempDir-001/jetty4
[junit4] 2> 867403 T3703 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 867403 T3703 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 867404 T3703 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 867404 T3703 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:357)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 867410 T3601 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/qub/e,null}
[junit4] 2> 867462 T3601 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 867463 T3601 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:58258 58258
[junit4] 2> 868306 T3602 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:58258 58258
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=410B5CBC4960987A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_TN -Dtests.timezone=America/Cayenne -Dtests.file.encoding=US-ASCII
[junit4] ERROR 64.7s J0 | SyncSliceTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
[junit4] > at __randomizedtesting.SeedInfo.seed([410B5CBC4960987A:C0EDD2A43E3FF846]:0)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:659)
[junit4] > at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
[junit4] > at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1141)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1110)
[junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 868327 T3601 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-410B5CBC4960987A-001
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ar_TN, timezone=America/Cayenne
[junit4] 2> NOTE: Linux 3.8.0-41-generic i386/Oracle Corporation 1.8.0_05 (32-bit)/cpus=8,threads=1,free=82425320,total=215535616
[junit4] 2> NOTE: All tests run in this JVM: [UpdateRequestProcessorFactoryTest, SpellingQueryConverterTest, FastVectorHighlighterTest, TestStandardQParsers, TestRemoteStreaming, TestSearchPerf, TestPostingsSolrHighlighter, SearchHandlerTest, TestExtendedDismaxParser, SampleTest, ChaosMonkeyNothingIsSafeTest, RegexBoostProcessorTest, TestSchemaVersionResource, TestExceedMaxTermLength, TestFastLRUCache, TestDocSet, TestCopyFieldCollectionResource, HdfsBasicDistributedZk2Test, SolrInfoMBeanTest, HighlighterMaxOffsetTest, DirectUpdateHandlerOptimizeTest, QueryElevationComponentTest, TestMaxScoreQueryParser, MBeansHandlerTest, TestDistributedMissingSort, LeaderElectionTest, AsyncMigrateRouteKeyTest, RAMDirectoryFactoryTest, CoreAdminCreateDiscoverTest, TestRequestStatusCollectionAPI, SynonymTokenizerTest, MoreLikeThisHandlerTest, DistributedDebugComponentTest, SuggesterTest, TestReversedWildcardFilterFactory, BadComponentTest, QueryParsingTest, TestManagedSynonymFilterFactory, TestCoreContainer, TestFieldSortValues, TestDefaultSearchFieldResource, FileBasedSpellCheckerTest, ScriptEngineTest, TestElisionMultitermQuery, TimeZoneUtilsTest, TestGroupingSearch, TestWriterPerf, SolrIndexSplitterTest, TestSolrQueryParser, TestConfig, TestCharFilters, AbstractAnalyticsFacetTest, SolrCoreTest, BadCopyFieldTest, TestShardHandlerFactory, DistributedQueryComponentCustomSortTest, ShardRoutingTest, TestJmxMonitoredMap, URLClassifyProcessorTest, QueryResultKeyTest, DocumentBuilderTest, SpellPossibilityIteratorTest, TestRealTimeGet, HdfsRecoveryZkTest, CoreAdminHandlerTest, UpdateParamsTest, ClusterStateTest, ExternalFileFieldSortTest, HdfsDirectoryTest, DistributedTermsComponentTest, PreAnalyzedFieldTest, HttpPartitionTest, BasicDistributedZkTest, TermVectorComponentTest, ParsingFieldUpdateProcessorsTest, ResponseLogComponentTest, RankQueryTest, TestInitQParser, TestSort, SoftAutoCommitTest, CopyFieldTest, TestMiniSolrCloudCluster, TestLMJelinekMercerSimilarityFactory, TestSolrQueryParserResource, TestCloudManagedSchema, TestMergePolicyConfig, TestManagedSchemaFieldResource, IndexSchemaTest, TestBadConfig, JsonLoaderTest, EchoParamsTest, SchemaVersionSpecificBehaviorTest, TestReplicationHandlerBackup, TestCursorMarkWithoutUniqueKey, HdfsWriteToMultipleCollectionsTest, SliceStateTest, WordBreakSolrSpellCheckerTest, DocValuesTest, AnalysisAfterCoreReloadTest, DistributedSpellCheckComponentTest, TestChildDocTransformer, BasicDistributedZk2Test, UnloadDistributedZkTest, SyncSliceTest]
[junit4] Completed on J0 in 64.70s, 1 test, 1 error <<< FAILURES!
[...truncated 641 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 415 suites, 1703 tests, 1 error, 36 ignored (15 assumptions)
Total time: 65 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_05 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b15) -
Build # 10597 - Still Failing!
Posted by "david.w.smiley@gmail.com" <da...@gmail.com>.
This is not a spatial bug; it’s another case of:
https://issues.apache.org/jira/browse/LUCENE-5713
~ David Smiley
Freelance Apache Lucene/Solr Search Consultant/Developer
http://www.linkedin.com/in/davidwsmiley
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b15) -
Build # 10597 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10597/
Java: 32bit/jdk1.8.0_20-ea-b15 -client -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.lucene.spatial.prefix.SpatialOpRecursivePrefixTreeTest.testDisjoint {#5 seed=[343FD74DE3FD2951:55D28603D86E17E7]}
Error Message:
CheckReader failed
Stack Trace:
java.lang.RuntimeException: CheckReader failed
at __randomizedtesting.SeedInfo.seed([343FD74DE3FD2951:55D28603D86E17E7]:0)
at org.apache.lucene.util.TestUtil.checkReader(TestUtil.java:240)
at org.apache.lucene.util.TestUtil.checkReader(TestUtil.java:218)
at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1598)
at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1572)
at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1564)
at org.apache.lucene.spatial.SpatialTestCase.commit(SpatialTestCase.java:133)
at org.apache.lucene.spatial.prefix.SpatialOpRecursivePrefixTreeTest.doTest(SpatialOpRecursivePrefixTreeTest.java:283)
at org.apache.lucene.spatial.prefix.SpatialOpRecursivePrefixTreeTest.testDisjoint(SpatialOpRecursivePrefixTreeTest.java:144)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9506 lines...]
[junit4] Suite: org.apache.lucene.spatial.prefix.SpatialOpRecursivePrefixTreeTest
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:8,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:1,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:2,ctx:SpatialContext.GEO)))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:4,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:2,ctx:SpatialContext.GEO)))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:3,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:1,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:4,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:4,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:7,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:2,ctx:SpatialContext.GEO)))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:2,ctx:SpatialContext.GEO)))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:5,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:1,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:2,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:7,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:6,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:1,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:3,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:3,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:6,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:3,ctx:SpatialContext.GEO)))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:1,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:1,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:1,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:3,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:3,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})))
[junit4] 1> CheckReader failed
[junit4] 1> test: field norms.........OK [0 fields]
[junit4] 1> test: terms, freq, prox...OK [89 terms; 107 terms/docs pairs; 0 tokens]
[junit4] 1> test: stored fields.......OK [9 total field count; avg 1.8 fields per doc]
[junit4] 1> test: term vectors........OK [0 total vector count; avg 0 term/freq vector fields per doc]
[junit4] 1> test: docvalues...........ERROR [dv for field: SpatialOpRecursivePrefixTreeTest has -1 ord but is not marked missing for doc: 0]
[junit4] 1> java.lang.RuntimeException: dv for field: SpatialOpRecursivePrefixTreeTest has -1 ord but is not marked missing for doc: 0
[junit4] 1> at org.apache.lucene.index.CheckIndex.checkSortedDocValues(CheckIndex.java:1416)
[junit4] 1> at org.apache.lucene.index.CheckIndex.checkDocValues(CheckIndex.java:1560)
[junit4] 1> at org.apache.lucene.index.CheckIndex.testDocValues(CheckIndex.java:1369)
[junit4] 1> at org.apache.lucene.util.TestUtil.checkReader(TestUtil.java:231)
[junit4] 1> at org.apache.lucene.util.TestUtil.checkReader(TestUtil.java:218)
[junit4] 1> at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1598)
[junit4] 1> at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1572)
[junit4] 1> at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1564)
[junit4] 1> at org.apache.lucene.spatial.SpatialTestCase.commit(SpatialTestCase.java:133)
[junit4] 1> at org.apache.lucene.spatial.prefix.SpatialOpRecursivePrefixTreeTest.doTest(SpatialOpRecursivePrefixTreeTest.java:283)
[junit4] 1> at org.apache.lucene.spatial.prefix.SpatialOpRecursivePrefixTreeTest.testDisjoint(SpatialOpRecursivePrefixTreeTest.java:144)
[junit4] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 1> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
[junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
[junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
[junit4] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
[junit4] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
[junit4] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
[junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
[junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
[junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
[junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
[junit4] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
[junit4] 1> at java.lang.Thread.run(Thread.java:745)
[junit4] 1>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SpatialOpRecursivePrefixTreeTest -Dtests.method=testDisjoint -Dtests.seed=343FD74DE3FD2951 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=America/Scoresbysund -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.16s J0 | SpatialOpRecursivePrefixTreeTest.testDisjoint {#5 seed=[343FD74DE3FD2951:55D28603D86E17E7]} <<<
[junit4] > Throwable #1: java.lang.RuntimeException: CheckReader failed
[junit4] > at __randomizedtesting.SeedInfo.seed([343FD74DE3FD2951:55D28603D86E17E7]:0)
[junit4] > at org.apache.lucene.util.TestUtil.checkReader(TestUtil.java:240)
[junit4] > at org.apache.lucene.util.TestUtil.checkReader(TestUtil.java:218)
[junit4] > at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1598)
[junit4] > at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1572)
[junit4] > at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1564)
[junit4] > at org.apache.lucene.spatial.SpatialTestCase.commit(SpatialTestCase.java:133)
[junit4] > at org.apache.lucene.spatial.prefix.SpatialOpRecursivePrefixTreeTest.doTest(SpatialOpRecursivePrefixTreeTest.java:283)
[junit4] > at org.apache.lucene.spatial.prefix.SpatialOpRecursivePrefixTreeTest.testDisjoint(SpatialOpRecursivePrefixTreeTest.java:144)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:1,ctx:SpatialContext.GEO)),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:6,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:4,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})))
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(QuadPrefixTree(maxLevels:6,ctx:SpatialContext{geo=false, calculator=CartesianDistCalc, worldBounds=Rect(minX=0.0,maxX=256.0,minY=-128.0,maxY=128.0)})),pruneLeafyBranches)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene49), sim=DefaultSimilarity, locale=ro, timezone=America/Scoresbysund
[junit4] 2> NOTE: Linux 3.8.0-41-generic i386/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=8,threads=1,free=279066520,total=400424960
[junit4] 2> NOTE: All tests run in this JVM: [DateRangePrefixTreeTest, TestRecursivePrefixTreeStrategy, SpatialPrefixTreeTest, SerializedStrategyTest, TestPointVectorStrategy, PortedSolr3Test, SpatialOpRecursivePrefixTreeTest]
[junit4] Completed on J0 in 2.70s, 44 tests, 1 error <<< FAILURES!
[...truncated 35 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:543: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:2017: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/module-build.xml:60: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 17 suites, 126 tests, 1 error, 12 ignored (2 assumptions)
Total time: 44 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_20-ea-b15 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_20-ea-b15) -
Build # 10596 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10596/
Java: 64bit/jdk1.8.0_20-ea-b15 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
3 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
commitWithin did not work expected:<68> but was:<67>
Stack Trace:
java.lang.AssertionError: commitWithin did not work expected:<68> but was:<67>
at __randomizedtesting.SeedInfo.seed([EE53F04675040232:6FB57E5E025B620E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:347)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.RollingRestartTest.testDistribSearch
Error Message:
No overseer designate as leader found after restart #1: 127.0.0.1:39223_f_sna%2Fsk
Stack Trace:
java.lang.AssertionError: No overseer designate as leader found after restart #1: 127.0.0.1:39223_f_sna%2Fsk
at __randomizedtesting.SeedInfo.seed([EE53F04675040232:6FB57E5E025B620E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:100)
at org.apache.solr.cloud.RollingRestartTest.doTest(RollingRestartTest.java:61)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
at __randomizedtesting.SeedInfo.seed([EE53F04675040232:6FB57E5E025B620E]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:659)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1141)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1110)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11056 lines...]
[junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/init-core-data-001
[junit4] 2> 417512 T1826 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 417514 T1826 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 417514 T1826 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 417515 T1827 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 417615 T1826 oasc.ZkTestServer.run start zk server on port:44743
[junit4] 2> 417615 T1826 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 417686 T1833 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63aeb423 name:ZooKeeperConnection Watcher:127.0.0.1:44743 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 417686 T1826 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 417686 T1826 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 417691 T1826 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 417692 T1835 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c760376 name:ZooKeeperConnection Watcher:127.0.0.1:44743/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 417692 T1826 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 417692 T1826 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 417694 T1826 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 417696 T1826 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 417697 T1826 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 417698 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 417698 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 417701 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 417701 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 417703 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 417704 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 417706 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 417707 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 417710 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 417710 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 417711 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 417712 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 417713 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 417713 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 417715 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 417716 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 417717 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 417717 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 417719 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 417719 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 417721 T1826 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 417721 T1826 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 417938 T1826 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 417947 T1826 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55638
[junit4] 2> 417948 T1826 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 417948 T1826 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 417949 T1826 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-002
[junit4] 2> 417949 T1826 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-002/'
[junit4] 2> 417964 T1826 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-002/solr.xml
[junit4] 2> 417973 T1826 oasc.CoreContainer.<init> New CoreContainer 324481100
[junit4] 2> 417974 T1826 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-002/]
[junit4] 2> 417974 T1826 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 417975 T1826 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 417975 T1826 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 417975 T1826 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 417976 T1826 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 417976 T1826 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 417976 T1826 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 417977 T1826 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 417977 T1826 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 417978 T1826 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 417978 T1826 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 417978 T1826 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 417979 T1826 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44743/solr
[junit4] 2> 417979 T1826 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 417980 T1826 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 417982 T1846 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36a2ca3f name:ZooKeeperConnection Watcher:127.0.0.1:44743 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 417982 T1826 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 417984 T1826 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 417985 T1848 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ff357d name:ZooKeeperConnection Watcher:127.0.0.1:44743/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 417985 T1826 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 417987 T1826 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 417989 T1826 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 417991 T1826 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 417992 T1826 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 417994 T1826 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 417997 T1826 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 417999 T1826 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55638_
[junit4] 2> 417999 T1826 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55638_
[junit4] 2> 418006 T1826 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 418007 T1826 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 418009 T1826 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55638_
[junit4] 2> 418010 T1826 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 418011 T1826 oasc.Overseer.start Overseer (id=91956129065140227-127.0.0.1:55638_-n_0000000000) starting
[junit4] 2> 418012 T1826 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 418018 T1850 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 418019 T1826 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 418029 T1826 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 418031 T1826 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 418035 T1849 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 418035 T1851 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 418036 T1851 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 418036 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 418037 T1851 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 418037 T1849 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 418038 T1849 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55638",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55638_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 418038 T1849 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 418038 T1849 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 418040 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 418041 T1848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 419038 T1851 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 419038 T1851 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 419039 T1851 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 419039 T1851 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 419041 T1851 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 419042 T1851 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-002/collection1/'
[junit4] 2> 419042 T1851 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 419043 T1851 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 419043 T1851 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 419082 T1851 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 419097 T1851 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 419098 T1851 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 419102 T1851 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 419191 T1851 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 419194 T1851 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 419195 T1851 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 419201 T1851 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 419203 T1851 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 419204 T1851 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 419205 T1851 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 419206 T1851 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 419206 T1851 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 419206 T1851 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 419207 T1851 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 419207 T1851 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 419207 T1851 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 419207 T1851 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/control/data/
[junit4] 2> 419207 T1851 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e1215da
[junit4] 2> 419208 T1851 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/control/data
[junit4] 2> 419208 T1851 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/control/data/index/
[junit4] 2> 419208 T1851 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 419208 T1851 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/control/data/index
[junit4] 2> 419209 T1851 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=615315348, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 419209 T1851 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6f587b47 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6c7d1edf),segFN=segments_1,generation=1}
[junit4] 2> 419209 T1851 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 419211 T1851 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 419211 T1851 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 419212 T1851 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 419212 T1851 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 419212 T1851 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 419212 T1851 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 419212 T1851 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 419213 T1851 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 419213 T1851 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 419213 T1851 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 419213 T1851 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 419213 T1851 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 419214 T1851 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 419214 T1851 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 419214 T1851 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 419214 T1851 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 419215 T1851 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 419216 T1851 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 419218 T1851 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 419218 T1851 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 419219 T1851 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6746318020706255]
[junit4] 2> 419219 T1851 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6f587b47 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6c7d1edf),segFN=segments_1,generation=1}
[junit4] 2> 419219 T1851 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 419219 T1851 oass.SolrIndexSearcher.<init> Opening Searcher@23f7eb96[collection1] main
[junit4] 2> 419220 T1851 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 419221 T1851 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 419221 T1851 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 419221 T1851 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 419221 T1851 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 419221 T1851 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 419222 T1851 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 419222 T1851 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 419222 T1851 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 419222 T1851 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 419223 T1852 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23f7eb96[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 419224 T1851 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 419225 T1855 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55638 collection:control_collection shard:shard1
[junit4] 2> 419225 T1826 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 419225 T1826 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 419225 T1855 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 419226 T1826 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 419227 T1857 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ccee759 name:ZooKeeperConnection Watcher:127.0.0.1:44743/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 419227 T1826 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 419228 T1826 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 419229 T1855 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 419230 T1826 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 419230 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 419230 T1855 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 419230 T1855 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1237 name=collection1 org.apache.solr.core.SolrCore@28b88f7a url=http://127.0.0.1:55638/collection1 node=127.0.0.1:55638_ C1237_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55638, core=collection1, node_name=127.0.0.1:55638_}
[junit4] 2> 419231 T1855 C1237 P55638 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55638/collection1/
[junit4] 2> 419231 T1849 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 419231 T1855 C1237 P55638 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 419231 T1855 C1237 P55638 oasc.SyncStrategy.syncToMe http://127.0.0.1:55638/collection1/ has no replicas
[junit4] 2> 419231 T1855 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55638/collection1/ shard1
[junit4] 2> 419232 T1855 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 419233 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 419237 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 419239 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 419340 T1857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 419340 T1848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 419388 T1855 oasc.ZkController.register We are http://127.0.0.1:55638/collection1/ and leader is http://127.0.0.1:55638/collection1/
[junit4] 2> 419388 T1855 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55638
[junit4] 2> 419388 T1855 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 419389 T1855 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 419389 T1855 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 419390 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 419390 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 419390 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 419390 T1855 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 419391 T1849 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 419392 T1849 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55638",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55638_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 419394 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 419449 T1826 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 419450 T1826 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 419451 T1826 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:32889
[junit4] 2> 419452 T1826 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 419452 T1826 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 419452 T1826 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-003
[junit4] 2> 419453 T1826 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-003/'
[junit4] 2> 419462 T1826 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-003/solr.xml
[junit4] 2> 419473 T1826 oasc.CoreContainer.<init> New CoreContainer 1838933848
[junit4] 2> 419474 T1826 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-003/]
[junit4] 2> 419474 T1826 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 419474 T1826 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 419474 T1826 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 419474 T1826 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 419475 T1826 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 419475 T1826 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 419475 T1826 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 419475 T1826 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 419476 T1826 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 419476 T1826 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 419476 T1826 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 419476 T1826 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 419477 T1826 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44743/solr
[junit4] 2> 419477 T1826 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 419478 T1826 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 419483 T1868 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f9819c name:ZooKeeperConnection Watcher:127.0.0.1:44743 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 419484 T1826 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 419488 T1826 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 419489 T1870 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69cd30eb name:ZooKeeperConnection Watcher:127.0.0.1:44743/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 419489 T1826 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 419495 T1857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 419495 T1848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 419496 T1826 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 420500 T1826 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32889_
[junit4] 2> 420502 T1826 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32889_
[junit4] 2> 420510 T1871 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 420510 T1871 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 420515 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 420515 T1871 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 420515 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 420516 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 420518 T1849 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 420519 T1849 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:32889",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:32889_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 420520 T1849 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 420520 T1849 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 420523 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 420626 T1857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 420626 T1848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 420626 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 421516 T1871 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 421516 T1871 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 421517 T1871 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 421518 T1871 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 421519 T1871 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 421519 T1871 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-003/collection1/'
[junit4] 2> 421520 T1871 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 421521 T1871 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 421521 T1871 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 421553 T1871 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 421568 T1871 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 421570 T1871 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 421573 T1871 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 421659 T1871 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 421662 T1871 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 421663 T1871 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 421675 T1871 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 421677 T1871 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 421679 T1871 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 421680 T1871 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 421681 T1871 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 421681 T1871 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 421683 T1871 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 421683 T1871 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 421683 T1871 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 421683 T1871 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 421684 T1871 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty1/
[junit4] 2> 421684 T1871 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e1215da
[junit4] 2> 421685 T1871 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty1
[junit4] 2> 421685 T1871 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty1/index/
[junit4] 2> 421685 T1871 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 421686 T1871 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty1/index
[junit4] 2> 421687 T1871 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=615315348, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 421687 T1871 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@20c3e6a7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60a4bf9a),segFN=segments_1,generation=1}
[junit4] 2> 421688 T1871 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 421691 T1871 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 421692 T1871 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 421697 T1871 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 421697 T1871 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 421698 T1871 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 421698 T1871 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 421698 T1871 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 421699 T1871 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 421699 T1871 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 421699 T1871 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 421700 T1871 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 421700 T1871 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 421701 T1871 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 421701 T1871 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 421702 T1871 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 421702 T1871 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 421703 T1871 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 421705 T1871 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 421707 T1871 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 421708 T1871 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 421708 T1871 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6746318020706255]
[junit4] 2> 421709 T1871 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@20c3e6a7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60a4bf9a),segFN=segments_1,generation=1}
[junit4] 2> 421709 T1871 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 421710 T1871 oass.SolrIndexSearcher.<init> Opening Searcher@76616f13[collection1] main
[junit4] 2> 421710 T1871 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 421711 T1871 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 421712 T1871 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 421713 T1871 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 421713 T1871 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 421713 T1871 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 421714 T1871 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 421715 T1871 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 421715 T1871 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 421715 T1871 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 421720 T1872 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@76616f13[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 421722 T1871 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 421723 T1875 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:32889 collection:collection1 shard:shard2
[junit4] 2> 421724 T1826 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 421724 T1826 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 421724 T1875 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 421729 T1875 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 421730 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 421731 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 421731 T1875 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 421731 T1875 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 421731 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C1238 name=collection1 org.apache.solr.core.SolrCore@31e94b0 url=http://127.0.0.1:32889/collection1 node=127.0.0.1:32889_ C1238_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:32889, core=collection1, node_name=127.0.0.1:32889_}
[junit4] 2> 421731 T1875 C1238 P32889 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:32889/collection1/
[junit4] 2> 421732 T1849 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 421732 T1875 C1238 P32889 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 421732 T1875 C1238 P32889 oasc.SyncStrategy.syncToMe http://127.0.0.1:32889/collection1/ has no replicas
[junit4] 2> 421733 T1875 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:32889/collection1/ shard2
[junit4] 2> 421733 T1875 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 421735 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 421737 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 421739 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 421843 T1857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 421843 T1848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 421843 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 421888 T1875 oasc.ZkController.register We are http://127.0.0.1:32889/collection1/ and leader is http://127.0.0.1:32889/collection1/
[junit4] 2> 421888 T1875 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32889
[junit4] 2> 421888 T1875 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 421888 T1875 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 421888 T1875 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 421889 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 421890 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 421890 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 421890 T1875 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 421891 T1849 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 421891 T1849 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:32889",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:32889_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 421892 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 421945 T1826 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 421946 T1826 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 421949 T1826 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58994
[junit4] 2> 421950 T1826 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 421951 T1826 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 421951 T1826 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-004
[junit4] 2> 421952 T1826 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-004/'
[junit4] 2> 421973 T1826 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-004/solr.xml
[junit4] 2> 421991 T1826 oasc.CoreContainer.<init> New CoreContainer 743981972
[junit4] 2> 421992 T1826 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-004/]
[junit4] 2> 421992 T1826 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 421992 T1826 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 421993 T1826 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 421993 T1826 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 421993 T1826 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 421993 T1826 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 421993 T1848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 421993 T1826 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 421994 T1826 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 421994 T1826 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 421993 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 421993 T1857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 421995 T1826 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 421995 T1826 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 421996 T1826 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 421996 T1826 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44743/solr
[junit4] 2> 421996 T1826 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 421997 T1826 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 421998 T1886 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35a5f372 name:ZooKeeperConnection Watcher:127.0.0.1:44743 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 421999 T1826 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 422003 T1826 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 422004 T1888 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d39ecb2 name:ZooKeeperConnection Watcher:127.0.0.1:44743/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 422004 T1826 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 422013 T1826 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 423015 T1826 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58994_
[junit4] 2> 423017 T1826 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58994_
[junit4] 2> 423025 T1889 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 423026 T1889 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 423030 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 423031 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 423031 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 423031 T1889 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 423033 T1849 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 423034 T1849 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58994",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:58994_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 423034 T1849 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 423034 T1849 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 423038 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 423140 T1857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 423140 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 423140 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 423140 T1848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 424032 T1889 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 424032 T1889 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 424033 T1889 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 424033 T1889 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 424034 T1889 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 424034 T1889 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-004/collection1/'
[junit4] 2> 424035 T1889 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 424035 T1889 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 424035 T1889 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 424060 T1889 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 424075 T1889 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 424076 T1889 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 424081 T1889 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 424204 T1889 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 424207 T1889 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 424208 T1889 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 424214 T1889 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 424216 T1889 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 424218 T1889 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 424218 T1889 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 424219 T1889 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 424219 T1889 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 424220 T1889 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 424220 T1889 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 424220 T1889 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 424220 T1889 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 424220 T1889 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty2/
[junit4] 2> 424221 T1889 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e1215da
[junit4] 2> 424222 T1889 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty2
[junit4] 2> 424222 T1889 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty2/index/
[junit4] 2> 424222 T1889 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 424223 T1889 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.BasicDistributedZkTest-EE53F04675040232-001/tempDir-001/jetty2/index
[junit4] 2> 424223 T1889 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=615315348, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 424224 T1889 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@d4b207c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@620d3f0d),segFN=segments_1,generation=1}
[junit4] 2> 424224 T1889 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 424227 T1889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 424228 T1889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 424228 T1889 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 424228 T1889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 424229 T1889 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 424229 T1889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 424229 T1889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 424229 T1889 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 424230 T1889 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 424230 T1889 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 424230 T1889 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 424231 T1889 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 424231 T1889 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 424231 T1889 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 424231 T1889 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 424232 T1889 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 424232 T1889 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 424233 T1889 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 424234 T1889 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 424235 T1889 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 424235 T1889 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6746318020706255]
[junit4] 2> 424236 T1889 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@d4b207c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@620d3f0d),segFN=segments_1,generation=1}
[junit4] 2> 424236 T1889 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 424236 T1889 oass.SolrIndexSearcher.<init> Opening Searcher@60a4bbc1[collection1] main
[junit4] 2> 424236 T1889 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 424237 T1889 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 424237 T1889 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 424238 T1889 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 424238 T1889 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 424238 T1889 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 424239 T1889 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 424239 T1889 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 424239 T1889 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 424240 T1889 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 424242 T1890 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60a4bbc1[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 424245 T1889 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 424245 T1893 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58994 collection:collection1 shard:shard1
[junit4] 2> 424246 T1826 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 424246 T1826 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 424253 T1893 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 424259 T1893 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 424261 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 424261 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 424261 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 424261 T1893 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 424262 T1893 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 424262 T1849 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C1239 name=collection1 org.apache.solr.core.SolrCore@36d87760 url=http://127.0.0.1:58994/collection1 node=127.0.0.1:58994_ C1239_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:58994, core=collection1, node_name=127.0.0.1:58994_}
[junit4] 2> 424262 T1893 C1239 P58994 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58994/collection1/
[junit4] 2> 424263 T1893 C1239 P58994 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 424263 T1893 C1239 P58994 oasc.SyncStrategy.syncToMe http://127.0.0.1:58994/collection1/ has no replicas
[junit4] 2> 424264 T1848 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 424265 T1893 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58994/collection1/ shard1
[junit4] 2> 424265 T1893 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 4
[...truncated too long message...]
lector.java:221)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:448)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:212)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:313)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:448)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:212)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:313)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:448)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:212)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:357)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] ERROR 64.3s J0 | SyncSliceTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
[junit4] > at __randomizedtesting.SeedInfo.seed([EE53F04675040232:6FB57E5E025B620E]:0)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:659)
[junit4] > at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
[junit4] > at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1141)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1110)
[junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1072150 T3916 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1072150 T3916 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1072150 T3812 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 1072150 T3916 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1072151 T3916 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:357)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-EE53F04675040232-001
[junit4] 2> NOTE: test params are: codec=Lucene49: {rnd_b=PostingsFormat(name=Lucene41WithOrds), other_tl1=PostingsFormat(name=Direct), _version_=PostingsFormat(name=Direct), multiDefault=Pulsing41(freqCutoff=7 minBlockSize=60 maxBlockSize=217), a_t=Pulsing41(freqCutoff=7 minBlockSize=60 maxBlockSize=217), intDefault=PostingsFormat(name=Direct), a_i1=Pulsing41(freqCutoff=7 minBlockSize=60 maxBlockSize=217), id=PostingsFormat(name=Lucene41WithOrds), text=PostingsFormat(name=FSTPulsing41), range_facet_l=Pulsing41(freqCutoff=7 minBlockSize=60 maxBlockSize=217), timestamp=Pulsing41(freqCutoff=7 minBlockSize=60 maxBlockSize=217)}, docValues:{timestamp=DocValuesFormat(name=Memory)}, sim=DefaultSimilarity, locale=ar_YE, timezone=Africa/Harare
[junit4] 2> NOTE: Linux 3.8.0-41-generic amd64/Oracle Corporation 1.8.0_20-ea (64-bit)/cpus=8,threads=1,free=66169624,total=303538176
[junit4] 2> NOTE: All tests run in this JVM: [SolrCoreTest, OverseerCollectionProcessorTest, TestBM25SimilarityFactory, TestFastLRUCache, SOLR749Test, CursorPagingTest, TestSolrQueryParser, TestAnalyzeInfixSuggestions, FileBasedSpellCheckerTest, TestCloudInspectUtil, TestSystemIdResolver, TestWriterPerf, DistributedDebugComponentTest, SampleTest, WordBreakSolrSpellCheckerTest, PrimitiveFieldTypeTest, TestCursorMarkWithoutUniqueKey, TestFieldTypeCollectionResource, StressHdfsTest, CircularListTest, TestFaceting, UUIDFieldTest, BinaryUpdateRequestHandlerTest, TestPseudoReturnFields, TestUtils, TestPostingsSolrHighlighter, StatelessScriptUpdateProcessorFactoryTest, TestSearchPerf, ScriptEngineTest, TestSuggestSpellingConverter, HdfsDirectoryTest, TestConfigSets, ClusterStateTest, TestBlendedInfixSuggestions, QueryEqualityTest, TestQueryUtils, JsonLoaderTest, CachingDirectoryFactoryTest, TestElisionMultitermQuery, TestSurroundQueryParser, CustomCollectionTest, CollectionsAPIAsyncDistributedZkTest, TestCloudManagedSchemaConcurrent, LeaderElectionTest, TestFunctionQuery, SliceStateUpdateTest, ParsingFieldUpdateProcessorsTest, LukeRequestHandlerTest, UnloadDistributedZkTest, HdfsRecoveryZkTest, TestStressVersions, TestMaxScoreQueryParser, TestFieldCollectionResource, SynonymTokenizerTest, UpdateRequestProcessorFactoryTest, BasicDistributedZkTest, IndexSchemaTest, AbstractAnalyticsFacetTest, URLClassifyProcessorTest, ResponseLogComponentTest, TestDistributedMissingSort, TestRequestStatusCollectionAPI, TestHighFrequencyDictionaryFactory, CoreAdminHandlerTest, TestHighlightDedupGrouping, TestNRTOpen, TestSimpleQParserPlugin, OverseerRolesTest, QueryParsingTest, DistributedTermsComponentTest, RAMDirectoryFactoryTest, TestManagedSchemaFieldResource, TestDocBasedVersionConstraints, AsyncMigrateRouteKeyTest, DocValuesTest, SolrInfoMBeanTest, SliceStateTest, TestShardHandlerFactory, EchoParamsTest, TestPHPSerializedResponseWriter, SoftAutoCommitTest, TestRandomDVFaceting, TestSchemaVersionResource, TestReversedWildcardFilterFactory, TestReplicationHandlerBackup, AutoCommitTest, DocumentBuilderTest, PeerSyncTest, TestJmxMonitoredMap, TestChildDocTransformer, RollingRestartTest, SyncSliceTest]
[junit4] Completed on J0 in 64.37s, 1 test, 1 error <<< FAILURES!
[...truncated 654 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 415 suites, 1703 tests, 1 error, 2 failures, 36 ignored (15 assumptions)
Total time: 76 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_20-ea-b15 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any