You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/07/12 05:38:46 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_05) - Build #
10791 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10791/
Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
at __randomizedtesting.SeedInfo.seed([2099A5C453115F52:A17F2BDC244E3F6E]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:659)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1142)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1111)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11116 lines...]
[junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/init-core-data-001
[junit4] 2> 179601 T977 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 179601 T977 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ly_wil/t
[junit4] 2> 179614 T977 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 179615 T977 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 179629 T978 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 179729 T977 oasc.ZkTestServer.run start zk server on port:33459
[junit4] 2> 179740 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 179745 T984 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f90c1da name:ZooKeeperConnection Watcher:127.0.0.1:33459 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 179745 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 179745 T977 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 179777 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 179777 T986 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69856dd2 name:ZooKeeperConnection Watcher:127.0.0.1:33459/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 179778 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 179778 T977 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 179779 T977 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 179782 T977 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 179783 T977 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 179785 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 179786 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 179788 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 179788 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 179790 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 179790 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 179792 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 179792 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 179794 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 179794 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 179796 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 179796 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 179798 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 179798 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 179800 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 179800 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 179803 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 179805 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 179807 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 179809 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 179814 T977 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 179814 T977 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 179840 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 179842 T988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8438b8f name:ZooKeeperConnection Watcher:127.0.0.1:33459/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 179842 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 180144 T977 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 180283 T977 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 180288 T977 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:48888
[junit4] 2> 180290 T977 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 180290 T977 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 180291 T977 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-002
[junit4] 2> 180291 T977 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-002/'
[junit4] 2> 180303 T977 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-002/solr.xml
[junit4] 2> 180310 T977 oasc.CoreContainer.<init> New CoreContainer 876071186
[junit4] 2> 180311 T977 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-002/]
[junit4] 2> 180311 T977 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 180311 T977 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 180311 T977 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 180312 T977 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 180312 T977 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 180312 T977 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 180312 T977 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 180312 T977 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 180313 T977 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 180315 T977 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 180315 T977 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 180316 T977 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 180316 T977 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33459/solr
[junit4] 2> 180316 T977 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 180317 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 180318 T999 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9124c90 name:ZooKeeperConnection Watcher:127.0.0.1:33459 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 180318 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 180320 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 180321 T1001 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@446c235f name:ZooKeeperConnection Watcher:127.0.0.1:33459/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 180321 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 180322 T977 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 180323 T977 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 180324 T977 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 180326 T977 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 180327 T977 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 180329 T977 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 180330 T977 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48888_ly_wil%2Ft
[junit4] 2> 180330 T977 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48888_ly_wil%2Ft
[junit4] 2> 180332 T977 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 180333 T977 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 180335 T977 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:48888_ly_wil%2Ft
[junit4] 2> 180335 T977 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 180336 T977 oasc.Overseer.start Overseer (id=92086925269663748-127.0.0.1:48888_ly_wil%2Ft-n_0000000000) starting
[junit4] 2> 180337 T977 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 180342 T1003 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 180342 T977 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 180343 T977 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 180344 T977 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 180345 T1002 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 180349 T1004 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 180350 T1004 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 180350 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 180350 T1004 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 180351 T1002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 180351 T1002 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:48888/ly_wil/t",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48888_ly_wil%2Ft",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 180352 T1002 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 180352 T1002 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 180353 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 180353 T1001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 181351 T1004 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 181351 T1004 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 181351 T1004 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 181351 T1004 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 181352 T1004 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 181352 T1004 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-002/collection1/'
[junit4] 2> 181353 T1004 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 181353 T1004 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 181354 T1004 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 181406 T1004 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 181417 T1004 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 181418 T1004 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 181424 T1004 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 181568 T1004 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 181574 T1004 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 181576 T1004 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 181598 T1004 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 181602 T1004 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 181605 T1004 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 181606 T1004 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 181606 T1004 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 181607 T1004 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 181608 T1004 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 181608 T1004 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 181608 T1004 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 181608 T1004 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 181609 T1004 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/control/data/
[junit4] 2> 181609 T1004 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6eff4256
[junit4] 2> 181610 T1004 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/control/data
[junit4] 2> 181610 T1004 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/control/data/index/
[junit4] 2> 181610 T1004 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 181610 T1004 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/control/data/index
[junit4] 2> 181611 T1004 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=33.404296875, floorSegmentMB=1.8603515625, forceMergeDeletesPctAllowed=18.552509955951123, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 181612 T1004 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1f36eb73 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d3c8630),segFN=segments_1,generation=1}
[junit4] 2> 181612 T1004 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 181616 T1004 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 181616 T1004 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 181616 T1004 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 181617 T1004 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 181617 T1004 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 181618 T1004 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 181620 T1004 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 181620 T1004 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 181621 T1004 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 181622 T1004 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 181622 T1004 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 181622 T1004 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 181623 T1004 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 181623 T1004 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 181623 T1004 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 181624 T1004 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 181624 T1004 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 181627 T1004 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 181643 T1004 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 181643 T1004 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 181644 T1004 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4551490738938203]
[junit4] 2> 181650 T1004 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1f36eb73 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d3c8630),segFN=segments_1,generation=1}
[junit4] 2> 181650 T1004 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 181650 T1004 oass.SolrIndexSearcher.<init> Opening Searcher@9c1c2f5[collection1] main
[junit4] 2> 181651 T1004 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 181652 T1004 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 181652 T1004 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 181653 T1004 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 181653 T1004 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 181653 T1004 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 181654 T1004 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 181655 T1004 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 181655 T1004 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 181657 T1004 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 181658 T1004 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 181658 T1004 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 181660 T1005 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9c1c2f5[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 181662 T1004 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 181678 T1008 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:48888/ly_wil/t collection:control_collection shard:shard1
[junit4] 2> 181679 T977 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 181679 T977 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 181685 T1008 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 181692 T1008 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 181694 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 181695 T1002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 181696 T1008 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 181696 T1008 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C162 name=collection1 org.apache.solr.core.SolrCore@6a384ca7 url=https://127.0.0.1:48888/ly_wil/t/collection1 node=127.0.0.1:48888_ly_wil%2Ft C162_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:48888/ly_wil/t, core=collection1, node_name=127.0.0.1:48888_ly_wil%2Ft}
[junit4] 2> 181696 T1008 C162 P48888 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:48888/ly_wil/t/collection1/
[junit4] 2> 181697 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 181697 T1008 C162 P48888 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 181697 T1008 C162 P48888 oasc.SyncStrategy.syncToMe https://127.0.0.1:48888/ly_wil/t/collection1/ has no replicas
[junit4] 2> 181698 T1008 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:48888/ly_wil/t/collection1/ shard1
[junit4] 2> 181698 T1008 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 181700 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 181701 T1010 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@358ab4a5 name:ZooKeeperConnection Watcher:127.0.0.1:33459/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 181702 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 181703 T977 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 181703 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 181705 T977 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 181709 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 181811 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 181812 T1001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 181854 T1008 oasc.ZkController.register We are https://127.0.0.1:48888/ly_wil/t/collection1/ and leader is https://127.0.0.1:48888/ly_wil/t/collection1/
[junit4] 2> 181855 T1008 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:48888/ly_wil/t
[junit4] 2> 181855 T1008 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 181855 T1008 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 181855 T1008 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 181856 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 181857 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 181857 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 181857 T1008 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 181858 T1002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 181858 T1002 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:48888/ly_wil/t",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48888_ly_wil%2Ft",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 181860 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 181961 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 181962 T1001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 182221 T977 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 182222 T977 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 182277 T977 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 182281 T977 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:35402
[junit4] 2> 182283 T977 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 182284 T977 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 182284 T977 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-003
[junit4] 2> 182284 T977 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-003/'
[junit4] 2> 182301 T977 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-003/solr.xml
[junit4] 2> 182310 T977 oasc.CoreContainer.<init> New CoreContainer 1163374516
[junit4] 2> 182310 T977 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-003/]
[junit4] 2> 182311 T977 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 182311 T977 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 182311 T977 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 182312 T977 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 182312 T977 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 182312 T977 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 182312 T977 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 182313 T977 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 182313 T977 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 182316 T977 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 182317 T977 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 182317 T977 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 182317 T977 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33459/solr
[junit4] 2> 182318 T977 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 182336 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 182337 T1021 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dfe5792 name:ZooKeeperConnection Watcher:127.0.0.1:33459 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 182338 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 182376 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 182376 T1023 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6df833d name:ZooKeeperConnection Watcher:127.0.0.1:33459/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 182377 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 182381 T977 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 183383 T977 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35402_ly_wil%2Ft
[junit4] 2> 183384 T977 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35402_ly_wil%2Ft
[junit4] 2> 183389 T1024 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 183390 T1024 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 183391 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 183391 T1024 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 183391 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 183391 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 183393 T1002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 183394 T1002 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:35402/ly_wil/t",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:35402_ly_wil%2Ft",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 183394 T1002 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 183394 T1002 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 183396 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 183497 T1023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 183497 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 183497 T1001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 184391 T1024 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 184392 T1024 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 184392 T1024 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 184392 T1024 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 184394 T1024 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 184394 T1024 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-003/collection1/'
[junit4] 2> 184395 T1024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 184396 T1024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 184396 T1024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 184414 T1024 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 184432 T1024 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 184433 T1024 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 184436 T1024 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 184537 T1024 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 184541 T1024 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 184542 T1024 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 184552 T1024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 184554 T1024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 184556 T1024 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 184556 T1024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 184557 T1024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 184557 T1024 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 184557 T1024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 184558 T1024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 184558 T1024 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 184558 T1024 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 184558 T1024 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty1/
[junit4] 2> 184558 T1024 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6eff4256
[junit4] 2> 184559 T1024 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty1
[junit4] 2> 184559 T1024 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty1/index/
[junit4] 2> 184559 T1024 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 184559 T1024 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty1/index
[junit4] 2> 184559 T1024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=33.404296875, floorSegmentMB=1.8603515625, forceMergeDeletesPctAllowed=18.552509955951123, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 184560 T1024 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@467982c8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@43fbb66b),segFN=segments_1,generation=1}
[junit4] 2> 184560 T1024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 184562 T1024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 184563 T1024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 184563 T1024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 184563 T1024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 184563 T1024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 184563 T1024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 184563 T1024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 184564 T1024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 184564 T1024 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 184564 T1024 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 184564 T1024 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 184564 T1024 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 184565 T1024 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 184565 T1024 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 184565 T1024 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 184565 T1024 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 184566 T1024 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 184567 T1024 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 184568 T1024 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 184568 T1024 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 184569 T1024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4551490738938203]
[junit4] 2> 184569 T1024 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@467982c8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@43fbb66b),segFN=segments_1,generation=1}
[junit4] 2> 184570 T1024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 184570 T1024 oass.SolrIndexSearcher.<init> Opening Searcher@5eaf2d87[collection1] main
[junit4] 2> 184570 T1024 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 184571 T1024 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 184571 T1024 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 184571 T1024 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 184571 T1024 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 184571 T1024 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 184572 T1024 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 184572 T1024 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 184572 T1024 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 184572 T1024 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 184575 T1025 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5eaf2d87[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 184575 T1024 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 184576 T1028 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:35402/ly_wil/t collection:collection1 shard:shard1
[junit4] 2> 184576 T977 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 184576 T1028 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 184576 T977 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 184579 T1028 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 184580 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 184580 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 184580 T1028 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 184580 T1028 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 184580 T1002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 184580 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C163 name=collection1 org.apache.solr.core.SolrCore@1876d5de url=https://127.0.0.1:35402/ly_wil/t/collection1 node=127.0.0.1:35402_ly_wil%2Ft C163_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:35402/ly_wil/t, core=collection1, node_name=127.0.0.1:35402_ly_wil%2Ft}
[junit4] 2> 184580 T1028 C163 P35402 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:35402/ly_wil/t/collection1/
[junit4] 2> 184581 T1028 C163 P35402 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 184581 T1028 C163 P35402 oasc.SyncStrategy.syncToMe https://127.0.0.1:35402/ly_wil/t/collection1/ has no replicas
[junit4] 2> 184581 T1028 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:35402/ly_wil/t/collection1/ shard1
[junit4] 2> 184581 T1028 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 184582 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 184584 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 184586 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 184687 T1001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 184687 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 184687 T1023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 184735 T1028 oasc.ZkController.register We are https://127.0.0.1:35402/ly_wil/t/collection1/ and leader is https://127.0.0.1:35402/ly_wil/t/collection1/
[junit4] 2> 184735 T1028 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:35402/ly_wil/t
[junit4] 2> 184735 T1028 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 184735 T1028 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 184735 T1028 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 184736 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 184736 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 184737 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 184737 T1028 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 184738 T1002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 184738 T1002 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:35402/ly_wil/t",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:35402_ly_wil%2Ft",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 184739 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 184824 T977 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 184824 T977 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 184828 T977 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 184830 T977 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:33514
[junit4] 2> 184832 T977 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 184833 T977 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 184833 T977 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-004
[junit4] 2> 184834 T977 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-004/'
[junit4] 2> 184841 T1023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 184841 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 184841 T1001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 184847 T977 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-004/solr.xml
[junit4] 2> 184857 T977 oasc.CoreContainer.<init> New CoreContainer 212100082
[junit4] 2> 184857 T977 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-004/]
[junit4] 2> 184858 T977 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 184858 T977 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 184858 T977 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 184859 T977 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 184859 T977 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 184859 T977 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 184859 T977 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 184860 T977 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 184860 T977 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 184863 T977 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 184864 T977 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 184864 T977 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 184864 T977 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33459/solr
[junit4] 2> 184865 T977 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 184866 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 184867 T1039 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f68059e name:ZooKeeperConnection Watcher:127.0.0.1:33459 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 184867 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 184869 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 184869 T1041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47033c87 name:ZooKeeperConnection Watcher:127.0.0.1:33459/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 184870 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 184874 T977 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 185877 T977 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33514_ly_wil%2Ft
[junit4] 2> 185877 T977 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33514_ly_wil%2Ft
[junit4] 2> 185883 T1042 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 185883 T1042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 185884 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 185884 T1042 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 185884 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 185884 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 185885 T1002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 185885 T1002 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33514/ly_wil/t",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33514_ly_wil%2Ft",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 185886 T1002 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 185886 T1002 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 185887 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 185989 T1023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 185989 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 185989 T1001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 185989 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 186884 T1042 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 186885 T1042 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 186885 T1042 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 186885 T1042 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 186886 T1042 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 186886 T1042 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-004/collection1/'
[junit4] 2> 186886 T1042 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 186887 T1042 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 186887 T1042 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 186909 T1042 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 186926 T1042 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 186927 T1042 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 186930 T1042 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 187020 T1042 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 187023 T1042 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 187024 T1042 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 187035 T1042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 187037 T1042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 187040 T1042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 187041 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 187041 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 187042 T1042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 187043 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 187043 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 187043 T1042 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 187044 T1042 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 187044 T1042 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty2/
[junit4] 2> 187044 T1042 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6eff4256
[junit4] 2> 187045 T1042 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty2
[junit4] 2> 187046 T1042 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty2/index/
[junit4] 2> 187046 T1042 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 187046 T1042 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty2/index
[junit4] 2> 187047 T1042 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=33.404296875, floorSegmentMB=1.8603515625, forceMergeDeletesPctAllowed=18.552509955951123, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 187047 T1042 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@29cbf597 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ebed8b5),segFN=segments_1,generation=1}
[junit4] 2> 187048 T1042 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 187051 T1042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 187051 T1042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 187052 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 187052 T1042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 187052 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 187052 T1042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 187053 T1042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 187053 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 187053 T1042 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 187053 T1042 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 187054 T1042 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 187054 T1042 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 187054 T1042 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 187054 T1042 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 187054 T1042 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 187055 T1042 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 187055 T1042 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 187057 T1042 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 187058 T1042 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 187058 T1042 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 187058 T1042 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4551490738938203]
[junit4] 2> 187059 T1042 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@29cbf597 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ebed8b5),segFN=segments_1,generation=1}
[junit4] 2> 187059 T1042 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 187059 T1042 oass.SolrIndexSearcher.<init> Opening Searcher@56b6249a[collection1] main
[junit4] 2> 187059 T1042 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 187060 T1042 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 187060 T1042 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 187060 T1042 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 187060 T1042 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 187061 T1042 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 187061 T1042 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 187061 T1042 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 187061 T1042 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 187062 T1042 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 187063 T1043 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56b6249a[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 187065 T1042 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 187069 T977 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 187069 T977 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 187070 T1046 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:33514/ly_wil/t collection:collection1 shard:shard1
[junit4] 2> 187080 T1046 oasc.ZkController.register We are https://127.0.0.1:33514/ly_wil/t/collection1/ and leader is https://127.0.0.1:35402/ly_wil/t/collection1/
[junit4] 2> 187080 T1046 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:33514/ly_wil/t
[junit4] 2> 187081 T1046 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 187081 T1046 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C164 name=collection1 org.apache.solr.core.SolrCore@4b9044eb url=https://127.0.0.1:33514/ly_wil/t/collection1 node=127.0.0.1:33514_ly_wil%2Ft C164_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:33514/ly_wil/t, core=collection1, node_name=127.0.0.1:33514_ly_wil%2Ft}
[junit4] 2> 187082 T1047 C164 P33514 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 187084 T1047 C164 P33514 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 187084 T1046 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 187084 T1047 C164 P33514 oasc.RecoveryStrategy.doRecovery Publishing state of core collection1 as recovering, leader is https://127.0.0.1:35402/ly_wil/t/collection1/ and I am https://127.0.0.1:33514/ly_wil/t/collection1/
[junit4] 2> 187084 T1047 C164 P33514 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 187085 T1047 C164 P33514 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 187086 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 187086 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 187086 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 187087 T1002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 187087 T1002 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "base_url":"https://127.0.0.1:33514/ly_wil/t",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33514_ly_wil%2Ft",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 187089 T1001 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 187089 T1047 C164 P33514 oasc.RecoveryStrategy.sendPrepRecoveryCmd Sending prep recovery command to https://127.0.0.1:35402/ly_wil/t; WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1%3A33514_ly_wil%252Ft&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true
[junit4] 2> 187190 T1023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 187190 T1001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 187190 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 187190 T1010 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 187240 T1015 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 187241 T1015 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 187242 T1015 oasha.CoreAdminHandler.handleWaitForStateAction Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 187242 T1015 oasha.CoreAdminHandler.handleWaitForStateAction In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:33514_ly_wil%2Ft, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"state":"recovering","base_url":"https://127.0.0.1:33514/ly_wil/t","core":"collection1","node_name":"127.0.0.1:33514_ly_wil%2Ft"}
[junit4] 2> 187242 T1015 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 187242 T1015 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:33514_ly_wil%252Ft&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node2&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 187370 T977 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 187370 T977 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 187374 T977 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 187375 T977 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52109
[junit4] 2> 187377 T977 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 187377 T977 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 187378 T977 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-005
[junit4] 2> 187378 T977 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-005/'
[junit4] 2> 187388 T977 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-005/solr.xml
[junit4] 2> 187406 T977 oasc.CoreContainer.<init> New CoreContainer 328635573
[junit4] 2> 187406 T977 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-005/]
[junit4] 2> 187407 T977 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 187407 T977 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 187407 T977 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 187407 T977 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 187408 T977 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 187408 T977 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 187408 T977 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 187408 T977 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 187408 T977 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 187411 T977 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 187411 T977 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 187411 T977 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 187411 T977 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33459/solr
[junit4] 2> 187412 T977 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 187412 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 187413 T1059 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ddbabec name:ZooKeeperConnection Watcher:127.0.0.1:33459 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 187414 T977 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 187415 T977 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 187416 T1061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@530cae57 name:ZooKeeperConnection Watcher:127.0.0.1:33459
[...truncated too long message...]
[junit4] 2> 235816 T1082 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was down, I won't be the leader.
[junit4] 2> 235816 T1082 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 235819 T977 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@318339e2
[junit4] 2> 235821 T977 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=13,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=654,transaction_logs_total_number=2}
[junit4] 2> 235822 T977 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 235822 T977 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 235822 T977 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 235822 T1082 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:46721_ly_wil%2Ft
[junit4] 2> 235823 T1082 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 235824 T977 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 235824 T1082 oasc.Overseer.start Overseer (id=92086925269663757-127.0.0.1:46721_ly_wil%2Ft-n_0000000004) starting
[junit4] 2> 235824 T977 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 235824 T977 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty4 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty4;done=false>>]
[junit4] 2> 235825 T977 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty4
[junit4] 2> 235825 T977 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty4/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty4/index;done=false>>]
[junit4] 2> 235825 T977 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001/tempDir-001/jetty4/index
[junit4] 2> 235828 T1082 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-map-running
[junit4] 2> at org.apache.solr.cloud.DistributedMap.<init>(DistributedMap.java:63)
[junit4] 2> at org.apache.solr.cloud.Overseer.getRunningMap(Overseer.java:1265)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.<init>(OverseerCollectionProcessor.java:197)
[junit4] 2> at org.apache.solr.cloud.Overseer.start(Overseer.java:1208)
[junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:533)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-map-running
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:226)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:223)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:223)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:100)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4] 2> at org.apache.solr.cloud.DistributedMap.<init>(DistributedMap.java:61)
[junit4] 2> ... 10 more
[junit4] 2>
[junit4] 2> 235829 T1082 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 235853 T977 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/ly_wil/t,null}
[junit4] 2> 235905 T977 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 235906 T977 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33459 33459
[junit4] 2> 236754 T978 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33459 33459
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=2099A5C453115F52 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_NZ -Dtests.timezone=SystemV/AST4ADT -Dtests.file.encoding=UTF-8
[junit4] ERROR 57.2s J0 | SyncSliceTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
[junit4] > at __randomizedtesting.SeedInfo.seed([2099A5C453115F52:A17F2BDC244E3F6E]:0)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:659)
[junit4] > at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
[junit4] > at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1142)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1111)
[junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 236781 T977 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-2099A5C453115F52-001
[junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=en_NZ, timezone=SystemV/AST4ADT
[junit4] 2> NOTE: Linux 3.8.0-42-generic amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=8,threads=1,free=61484968,total=236814336
[junit4] 2> NOTE: All tests run in this JVM: [TestSolr4Spatial2, AddBlockUpdateTest, TestJmxIntegration, SolrIndexSplitterTest, TestDocSet, AsyncMigrateRouteKeyTest, AliasIntegrationTest, TestBinaryResponseWriter, CachingDirectoryFactoryTest, ZkControllerTest, TestImplicitCoreProperties, TestMissingGroups, TestLMJelinekMercerSimilarityFactory, TestReload, OverseerTest, TestAnalyzedSuggestions, SyncSliceTest]
[junit4] Completed on J0 in 57.21s, 1 test, 1 error <<< FAILURES!
[...truncated 1138 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 418 suites, 1710 tests, 1 error, 38 ignored (17 assumptions)
Total time: 63 minutes 29 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_60) - Build #
10794 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10794/
Java: 64bit/jdk1.7.0_60 -XX:+UseCompressedOops -XX:+UseSerialGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
at __randomizedtesting.SeedInfo.seed([3D37F45A20A2BC6D:BCD17A4257FDDC51]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:659)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1142)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1111)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir
Error Message:
Error opening new searcher
Stack Trace:
org.apache.solr.common.SolrException: Error opening new searcher
at __randomizedtesting.SeedInfo.seed([3D37F45A20A2BC6D:D46D4F62BE3B2CC5]:0)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1578)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1690)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1434)
at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:615)
at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor.java:1652)
at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1629)
at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:157)
at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:267)
at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1980)
at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131)
at org.apache.solr.util.TestHarness.update(TestHarness.java:243)
at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:675)
at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:654)
at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:648)
at org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir(TestArbitraryIndexDir.java:128)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: Error opening Reader
at org.apache.solr.search.SolrIndexSearcher.getReader(SolrIndexSearcher.java:187)
at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:237)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1553)
... 62 more
Caused by: java.nio.file.NoSuchFileException: segments_1 in dir=NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestArbitraryIndexDir-3D37F45A20A2BC6D-001/tempDir-001/index_temp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a59536d
at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:574)
at org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:75)
at org.apache.lucene.store.Directory.openChecksumInput(Directory.java:106)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:339)
at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:54)
at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:787)
at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:50)
at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:64)
at org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:36)
at org.apache.solr.search.SolrIndexSearcher.getReader(SolrIndexSearcher.java:184)
... 64 more
Build Log:
[...truncated 11277 lines...]
[junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/init-core-data-001
[junit4] 2> 621778 T2660 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 621778 T2660 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 621780 T2660 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 621781 T2660 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 621781 T2661 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 621881 T2660 oasc.ZkTestServer.run start zk server on port:54879
[junit4] 2> 621882 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 621886 T2667 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@596e6196 name:ZooKeeperConnection Watcher:127.0.0.1:54879 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 621886 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 621887 T2660 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 621892 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 621893 T2669 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fa14635 name:ZooKeeperConnection Watcher:127.0.0.1:54879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 621893 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 621894 T2660 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 621897 T2660 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 621899 T2660 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 621901 T2660 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 621902 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 621902 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 621904 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 621905 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 621907 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 621908 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 621910 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 621910 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 621911 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 621912 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 621913 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 621913 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 621915 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 621915 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 621916 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 621917 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 621919 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 621920 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 621923 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 621924 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 621926 T2660 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 621926 T2660 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 621930 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 621931 T2671 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2213e972 name:ZooKeeperConnection Watcher:127.0.0.1:54879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 621931 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 622143 T2660 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 622146 T2660 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 622150 T2660 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:39542
[junit4] 2> 622151 T2660 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 622152 T2660 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 622152 T2660 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-002
[junit4] 2> 622152 T2660 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-002/'
[junit4] 2> 622164 T2660 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-002/solr.xml
[junit4] 2> 622204 T2660 oasc.CoreContainer.<init> New CoreContainer 2080912552
[junit4] 2> 622204 T2660 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-002/]
[junit4] 2> 622205 T2660 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 622206 T2660 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 622206 T2660 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 622206 T2660 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 622207 T2660 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 622207 T2660 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 622207 T2660 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 622208 T2660 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 622208 T2660 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 622210 T2660 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 622211 T2660 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 622211 T2660 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 622211 T2660 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54879/solr
[junit4] 2> 622211 T2660 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 622212 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 622213 T2682 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@500b5e3f name:ZooKeeperConnection Watcher:127.0.0.1:54879 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 622214 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 622216 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 622217 T2684 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f73f1f2 name:ZooKeeperConnection Watcher:127.0.0.1:54879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 622217 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 622219 T2660 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 622221 T2660 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 622223 T2660 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 622227 T2660 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 622230 T2660 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 622234 T2660 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 622236 T2660 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39542_
[junit4] 2> 622237 T2660 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39542_
[junit4] 2> 622240 T2660 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 622242 T2660 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 622246 T2660 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:39542_
[junit4] 2> 622246 T2660 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 622248 T2660 oasc.Overseer.start Overseer (id=92088795482488836-127.0.0.1:39542_-n_0000000000) starting
[junit4] 2> 622252 T2660 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 622262 T2686 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 622262 T2660 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 622264 T2660 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 622265 T2660 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 622266 T2685 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 622269 T2687 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 622269 T2687 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 622270 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 622270 T2687 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 622271 T2685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 622271 T2685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39542",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39542_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 622271 T2685 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 622272 T2685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 622274 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 622275 T2684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 623270 T2687 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 623271 T2687 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 623272 T2687 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 623272 T2687 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 623274 T2687 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 623274 T2687 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-002/collection1/'
[junit4] 2> 623275 T2687 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 623276 T2687 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 623276 T2687 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 623329 T2687 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 623349 T2687 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 623350 T2687 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 623355 T2687 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 623531 T2687 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 623535 T2687 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 623536 T2687 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 623545 T2687 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 623547 T2687 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 623550 T2687 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 623551 T2687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 623552 T2687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 623552 T2687 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 623553 T2687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 623554 T2687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 623554 T2687 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 623554 T2687 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 623554 T2687 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/control/data/
[junit4] 2> 623554 T2687 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a82b5c3
[junit4] 2> 623555 T2687 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/control/data
[junit4] 2> 623555 T2687 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/control/data/index/
[junit4] 2> 623555 T2687 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 623556 T2687 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/control/data/index
[junit4] 2> 623556 T2687 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=41.904296875, floorSegmentMB=2.017578125, forceMergeDeletesPctAllowed=5.221697825798341, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 623557 T2687 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3677288e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@20ea4eb1),segFN=segments_1,generation=1}
[junit4] 2> 623557 T2687 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 623560 T2687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 623561 T2687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 623561 T2687 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 623561 T2687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 623562 T2687 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 623562 T2687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 623562 T2687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 623562 T2687 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 623563 T2687 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 623563 T2687 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 623563 T2687 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 623563 T2687 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 623564 T2687 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 623564 T2687 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 623564 T2687 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 623565 T2687 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 623565 T2687 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 623568 T2687 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 623570 T2687 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 623570 T2687 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 623571 T2687 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=776766929, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 623572 T2687 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3677288e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@20ea4eb1),segFN=segments_1,generation=1}
[junit4] 2> 623572 T2687 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 623572 T2687 oass.SolrIndexSearcher.<init> Opening Searcher@49d1534b[collection1] main
[junit4] 2> 623572 T2687 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 623573 T2687 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 623574 T2687 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 623574 T2687 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 623574 T2687 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 623575 T2687 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 623576 T2687 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 623576 T2687 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 623577 T2687 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 623579 T2687 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 623580 T2687 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 623580 T2687 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 623581 T2688 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49d1534b[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 623583 T2687 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 623583 T2691 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:39542 collection:control_collection shard:shard1
[junit4] 2> 623584 T2660 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 623584 T2660 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 623584 T2691 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 623587 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 623588 T2693 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51dd1c60 name:ZooKeeperConnection Watcher:127.0.0.1:54879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 623589 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 623589 T2691 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 623589 T2660 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 623590 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 623590 T2691 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 623590 T2691 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1378 name=collection1 org.apache.solr.core.SolrCore@168e5eb4 url=https://127.0.0.1:39542/collection1 node=127.0.0.1:39542_ C1378_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:39542, core=collection1, node_name=127.0.0.1:39542_}
[junit4] 2> 623591 T2691 C1378 P39542 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:39542/collection1/
[junit4] 2> 623591 T2660 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 623591 T2691 C1378 P39542 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 623591 T2685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 623591 T2691 C1378 P39542 oasc.SyncStrategy.syncToMe https://127.0.0.1:39542/collection1/ has no replicas
[junit4] 2> 623592 T2691 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:39542/collection1/ shard1
[junit4] 2> 623592 T2691 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 623593 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 623594 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 623596 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 623697 T2684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 623697 T2693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 623745 T2691 oasc.ZkController.register We are https://127.0.0.1:39542/collection1/ and leader is https://127.0.0.1:39542/collection1/
[junit4] 2> 623746 T2691 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:39542
[junit4] 2> 623746 T2691 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 623746 T2691 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 623746 T2691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 623747 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 623748 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 623748 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 623748 T2691 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 623749 T2685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 623749 T2685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:39542",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39542_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 623751 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 623832 T2660 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 623832 T2660 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 623837 T2660 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 623839 T2660 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:43348
[junit4] 2> 623843 T2660 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 623843 T2660 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 623844 T2660 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-003
[junit4] 2> 623844 T2660 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-003/'
[junit4] 2> 623852 T2684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 623852 T2693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 623858 T2660 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-003/solr.xml
[junit4] 2> 623878 T2660 oasc.CoreContainer.<init> New CoreContainer 1729308890
[junit4] 2> 623878 T2660 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-003/]
[junit4] 2> 623879 T2660 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 623879 T2660 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 623879 T2660 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 623880 T2660 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 623880 T2660 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 623880 T2660 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 623880 T2660 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 623880 T2660 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 623881 T2660 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 623882 T2660 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 623883 T2660 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 623883 T2660 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 623883 T2660 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54879/solr
[junit4] 2> 623883 T2660 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 623884 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 623886 T2704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a92cb83 name:ZooKeeperConnection Watcher:127.0.0.1:54879 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 623887 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 623889 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 623890 T2706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a64d0f6 name:ZooKeeperConnection Watcher:127.0.0.1:54879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 623891 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 623896 T2660 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 624900 T2660 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43348_
[junit4] 2> 624901 T2660 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43348_
[junit4] 2> 624913 T2707 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 624913 T2707 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 624914 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 624915 T2707 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 624915 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 624915 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 624917 T2685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 624918 T2685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:43348",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43348_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 624918 T2685 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 624919 T2685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 624921 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 625023 T2693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 625023 T2684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 625023 T2706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 625915 T2707 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 625915 T2707 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 625916 T2707 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 625917 T2707 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 625918 T2707 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 625918 T2707 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-003/collection1/'
[junit4] 2> 625919 T2707 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 625920 T2707 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 625920 T2707 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 625960 T2707 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 625981 T2707 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 625983 T2707 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 625988 T2707 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 626181 T2707 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 626185 T2707 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 626187 T2707 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 626199 T2707 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 626202 T2707 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 626204 T2707 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 626205 T2707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 626206 T2707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 626207 T2707 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 626208 T2707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 626208 T2707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 626208 T2707 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 626208 T2707 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 626209 T2707 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty1/
[junit4] 2> 626209 T2707 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a82b5c3
[junit4] 2> 626209 T2707 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty1
[junit4] 2> 626210 T2707 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty1/index/
[junit4] 2> 626210 T2707 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 626210 T2707 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty1/index
[junit4] 2> 626211 T2707 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=41.904296875, floorSegmentMB=2.017578125, forceMergeDeletesPctAllowed=5.221697825798341, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 626212 T2707 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3f6966d2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1754b72),segFN=segments_1,generation=1}
[junit4] 2> 626212 T2707 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 626217 T2707 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 626217 T2707 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 626218 T2707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 626218 T2707 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 626218 T2707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 626218 T2707 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 626219 T2707 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 626219 T2707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 626219 T2707 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 626220 T2707 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 626221 T2707 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 626221 T2707 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 626221 T2707 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 626222 T2707 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 626222 T2707 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 626223 T2707 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 626223 T2707 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 626227 T2707 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 626229 T2707 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 626230 T2707 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 626231 T2707 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=776766929, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 626231 T2707 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3f6966d2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1754b72),segFN=segments_1,generation=1}
[junit4] 2> 626231 T2707 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 626231 T2707 oass.SolrIndexSearcher.<init> Opening Searcher@74932e53[collection1] main
[junit4] 2> 626232 T2707 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 626232 T2707 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 626233 T2707 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 626233 T2707 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 626233 T2707 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 626233 T2707 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 626234 T2707 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 626235 T2707 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 626235 T2707 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 626235 T2707 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 626237 T2708 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@74932e53[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 626239 T2707 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 626240 T2711 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:43348 collection:collection1 shard:shard1
[junit4] 2> 626240 T2660 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 626241 T2660 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 626241 T2711 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 626248 T2711 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 626250 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 626250 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 626250 T2711 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 626250 T2711 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 626250 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C1379 name=collection1 org.apache.solr.core.SolrCore@5da538d1 url=https://127.0.0.1:43348/collection1 node=127.0.0.1:43348_ C1379_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:43348, core=collection1, node_name=127.0.0.1:43348_}
[junit4] 2> 626250 T2711 C1379 P43348 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:43348/collection1/
[junit4] 2> 626251 T2711 C1379 P43348 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 626251 T2685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 626251 T2711 C1379 P43348 oasc.SyncStrategy.syncToMe https://127.0.0.1:43348/collection1/ has no replicas
[junit4] 2> 626251 T2711 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:43348/collection1/ shard1
[junit4] 2> 626251 T2711 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 626252 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 626254 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 626255 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 626356 T2706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 626356 T2693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 626356 T2684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 626404 T2711 oasc.ZkController.register We are https://127.0.0.1:43348/collection1/ and leader is https://127.0.0.1:43348/collection1/
[junit4] 2> 626405 T2711 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:43348
[junit4] 2> 626405 T2711 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 626405 T2711 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 626405 T2711 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 626406 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 626407 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 626407 T2711 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 626407 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 626408 T2685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 626409 T2685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:43348",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43348_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 626410 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 626494 T2660 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 626495 T2660 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 626499 T2660 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 626500 T2660 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:57254
[junit4] 2> 626504 T2660 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 626504 T2660 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 626505 T2660 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-004
[junit4] 2> 626505 T2660 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-004/'
[junit4] 2> 626512 T2706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 626512 T2684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 626512 T2693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 626528 T2660 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-004/solr.xml
[junit4] 2> 626549 T2660 oasc.CoreContainer.<init> New CoreContainer 871537409
[junit4] 2> 626550 T2660 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-004/]
[junit4] 2> 626550 T2660 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 626550 T2660 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 626551 T2660 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 626551 T2660 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 626551 T2660 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 626551 T2660 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 626551 T2660 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 626552 T2660 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 626552 T2660 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 626554 T2660 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 626554 T2660 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 626554 T2660 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 626554 T2660 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54879/solr
[junit4] 2> 626555 T2660 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 626555 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 626557 T2722 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58de7d33 name:ZooKeeperConnection Watcher:127.0.0.1:54879 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 626558 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 626560 T2660 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 626561 T2724 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50fe74a9 name:ZooKeeperConnection Watcher:127.0.0.1:54879/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 626562 T2660 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 626568 T2660 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 627571 T2660 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57254_
[junit4] 2> 627572 T2660 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57254_
[junit4] 2> 627586 T2725 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 627587 T2725 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 627588 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 627588 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 627589 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 627588 T2725 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 627590 T2685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 627591 T2685 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:57254",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57254_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 627591 T2685 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 627592 T2685 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 627594 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 627697 T2684 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 627697 T2693 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 627697 T2724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 627697 T2706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 628589 T2725 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 628590 T2725 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 628590 T2725 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 628591 T2725 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 628592 T2725 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 628592 T2725 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-004/collection1/'
[junit4] 2> 628594 T2725 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 628594 T2725 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 628595 T2725 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 628651 T2725 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 628673 T2725 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 628675 T2725 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 628680 T2725 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 628890 T2725 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 628895 T2725 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 628896 T2725 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 628909 T2725 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 628911 T2725 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 628913 T2725 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 628914 T2725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 628915 T2725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 628915 T2725 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 628916 T2725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 628916 T2725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 628916 T2725 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 628916 T2725 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 628917 T2725 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty2/
[junit4] 2> 628917 T2725 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a82b5c3
[junit4] 2> 628918 T2725 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty2
[junit4] 2> 628918 T2725 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty2/index/
[junit4] 2> 628918 T2725 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 628919 T2725 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-3D37F45A20A2BC6D-001/tempDir-001/jetty2/index
[junit4] 2> 628919 T2725 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=41.904296875, floorSegmentMB=2.017578125, forceMergeDeletesPctAllowed=5.221697825798341, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 628920 T2725 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2fefc6f1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@76692d07),segFN=segments_1,generation=1}
[junit4] 2> 628920 T2725 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 628924 T2725 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 628924 T2725 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 628925 T2725 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 628925 T2725 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 628925 T2725 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 628925 T2725 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 628926 T2725 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 628926 T2725 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 628926 T2725 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 628927 T2725 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 628927 T2725 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 628927 T2725 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 628928 T2725 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 628928 T2725 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 628929 T2725 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 628929 T2725 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 628930 T2725 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 628932 T2725 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 628935 T2725 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 628935 T2725 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 628953 T2725 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=776766929, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 628954 T2725 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2fefc6f1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@76692d07),segFN=segments_1,generation=1}
[junit4] 2> 628954 T2725 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 628955 T2725 oass.SolrIndexSearcher.<init> Opening Searcher@1225f8a0[collection1] main
[junit4] 2> 628955 T2725 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 628957 T2725 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 628957 T2725 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 628958 T2725 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 628958 T2725 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 628958 T2725 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 628960 T2725 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 628960 T2725 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 628960 T2725 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 628960 T2725 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 628964 T2726 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1225f8a0[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 628966 T2725 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 628967 T2729 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:57254 collection:collection1 shard:shard1
[junit4] 2> 628967 T2660 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 628968 T2660 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 628969 T2729 oasc.ZkController.register We are https://127.0.0.1:57254/collection1/ and leader is https://127.0.0.1:43348/collection1/
[junit4] 2> 628969 T2729 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:57254
[junit4] 2> 628969 T2729 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 628969 T2729 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C1380 name=collection1 org.apache.solr.core.SolrCore@1f4f4abf url=https://127.0.0.1:57254/collection1 node=127.0.0.1:57254_ C1380_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:57254, core=collection1, node_name=127.0.0.1:57254_}
[junit4] 2> 628970 T2730 C1380 P57254 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 628970 T2729 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 628971 T2730 C1380 P57254 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 628972 T2730 C1380 P57254 oasc.RecoveryStrategy.doRecovery Publishing state of core collection1 as recovering, leader is https://127.0.0.1:43348/collection1/ and I am https://127.0.0.1:57254/collection1/
[junit4] 2> 628972 T2730 C1380 P57254 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 628972 T2730 C1380 P57254 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 628974 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 628974 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 628975 T2684 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 628976 T2685 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 628976 T2730 C1380 P57254 oasc.RecoveryStrategy.s
[...truncated too long message...]
owingOrOverridesOnMethodsRule.java:39)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 1> at java.lang.Thread.run(Thread.java:745)
[junit4] 1>
[junit4] 2> 1173488 T5627 oasc.SolrException.log ERROR Error closing directory:java.lang.RuntimeException: CheckIndex failed
[junit4] 2> at org.apache.lucene.util.TestUtil.checkIndex(TestUtil.java:205)
[junit4] 2> at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:692)
[junit4] 2> at org.apache.lucene.store.FilterDirectory.close(FilterDirectory.java:90)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:306)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.closeCacheValue(CachingDirectoryFactory.java:272)
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:202)
[junit4] 2> at org.apache.solr.core.SolrCore.close(SolrCore.java:1125)
[junit4] 2> at org.apache.solr.core.SolrCores.close(SolrCores.java:117)
[junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:332)
[junit4] 2> at org.apache.solr.util.TestHarness.close(TestHarness.java:337)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:632)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:183)
[junit4] 2> at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.core.TestArbitraryIndexDir-3D37F45A20A2BC6D-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=in, timezone=Asia/Brunei
[junit4] 2> NOTE: Linux 3.8.0-42-generic amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=8,threads=1,free=164142200,total=292962304
[junit4] 2> NOTE: All tests run in this JVM: [TestUniqueKeyFieldResource, ChaosMonkeySafeLeaderTest, BinaryUpdateRequestHandlerTest, TestBadConfig, ShardRoutingCustomTest, TestSuggestSpellingConverter, HdfsDirectoryTest, FullSolrCloudDistribCmdsTest, TestIBSimilarityFactory, TestReversedWildcardFilterFactory, DocValuesMissingTest, TestCollationFieldDocValues, TestImplicitCoreProperties, TestLFUCache, TestSerializedLuceneMatchVersion, MigrateRouteKeyTest, TestShortCircuitedRequests, SynonymTokenizerTest, SSLMigrationTest, CoreContainerCoreInitFailuresTest, DistributedTermsComponentTest, NoFacetTest, HdfsRecoveryZkTest, FileBasedSpellCheckerTest, SpatialFilterTest, MultiTermTest, DistributedQueryComponentOptimizationTest, TestPseudoReturnFields, HdfsChaosMonkeySafeLeaderTest, TestExtendedDismaxParser, TestLazyCores, InfoHandlerTest, OpenCloseCoreStressTest, SOLR749Test, TestRandomMergePolicy, TestCoreContainer, TermVectorComponentTest, LeaderElectionIntegrationTest, NumericFieldsTest, TestUpdate, SolrInfoMBeanTest, TestDocumentBuilder, TestFieldCollectionResource, DeleteReplicaTest, AddBlockUpdateTest, TestWriterPerf, RollingRestartTest, TestXIncludeConfig, TestJmxMonitoredMap, TestFunctionQuery, TestStressUserVersions, LukeRequestHandlerTest, TestSweetSpotSimilarityFactory, ResourceLoaderTest, TestSchemaNameResource, DistributedQueryElevationComponentTest, AlternateDirectoryTest, TestJoin, TestPostingsSolrHighlighter, SortByFunctionTest, EnumFieldTest, StressHdfsTest, TestRecovery, CoreMergeIndexesAdminHandlerTest, TestSolrXmlPersistor, TestCSVResponseWriter, TestNoOpRegenerator, AnalysisAfterCoreReloadTest, DistributedExpandComponentTest, TestDefaultSearchFieldResource, AtomicUpdatesTest, TestPhraseSuggestions, TestSimpleQParserPlugin, TestFiltering, TestRecoveryHdfs, TestExpandComponent, URLClassifyProcessorTest, DeleteShardTest, TestSolr4Spatial2, DocValuesTest, TestReloadAndDeleteDocs, ZkSolrClientTest, TestFieldSortValues, TestManagedResourceStorage, DateRangeFieldTest, BasicZkTest, ClusterStateTest, TestBM25SimilarityFactory, LoggingHandlerTest, TestRTGBase, ShardSplitTest, HardAutoCommitTest, TestFreeTextSuggestions, DirectSolrConnectionTest, StatsComponentTest, CSVRequestHandlerTest, OverseerRolesTest, TestRealTimeGet, TestQuerySenderNoQuery, DistributedSuggestComponentTest, OverseerTest, TestRandomFaceting, ZkCLITest, TestDistributedSearch, TestHashPartitioner, TestMultiCoreConfBootstrap, SimpleFacetsTest, SolrCoreTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, CurrencyFieldXmlFileTest, SimplePostToolTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SuggesterFSTTest, SolrRequestParserTest, SuggesterTest, TestTrie, PolyFieldTest, SchemaVersionSpecificBehaviorTest, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, DistanceFunctionTest, DebugComponentTest, TestSurroundQueryParser, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, TermsComponentTest, TestValueSourceCache, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir]
[junit4] Completed on J1 in 0.82s, 1 test, 1 error <<< FAILURES!
[...truncated 441 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 418 suites, 1710 tests, 2 errors, 38 ignored (17 assumptions)
Total time: 61 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0_60 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_60) - Build #
10793 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10793/
Java: 32bit/jdk1.7.0_60 -server -XX:+UseG1GC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([2BD1265C1938BC74]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Captured an uncaught exception in thread: Thread[id=337, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=337, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Caused by: java.lang.AssertionError: liveDocs.count()=2 info.docCount=5 info.getDelCount()=4
at __randomizedtesting.SeedInfo.seed([2BD1265C1938BC74]:0)
at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:115)
at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:133)
at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:185)
at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:95)
at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:393)
at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:269)
at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:204)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1489)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1690)
at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:673)
at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:493)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:337)
at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:163)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:447)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([2BD1265C1938BC74]:0)
Build Log:
[...truncated 11855 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/init-core-data-001
[junit4] 2> 17048 T64 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 17049 T64 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /c_cdz/yr
[junit4] 2> 17067 T64 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 17071 T64 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 17076 T65 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 17175 T64 oasc.ZkTestServer.run start zk server on port:59324
[junit4] 2> 17231 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 17242 T66 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 18662 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bee94 name:ZooKeeperConnection Watcher:127.0.0.1:59324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18662 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 18663 T64 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 18691 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 18692 T66 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14729612b610000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 18694 T73 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18b9e98 name:ZooKeeperConnection Watcher:127.0.0.1:59324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18695 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 18697 T64 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 18701 T64 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 18704 T64 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 18707 T64 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 18711 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 18711 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 18716 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 18716 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 18719 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 18720 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 18722 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 18723 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 18726 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 18726 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 18729 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 18730 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 18733 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 18733 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 18737 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 18738 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 18741 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 18741 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 18744 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 18745 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 18748 T64 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 18748 T64 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 18755 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 18757 T75 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@189e7b6 name:ZooKeeperConnection Watcher:127.0.0.1:59324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18757 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 19059 T64 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 19064 T64 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 19066 T64 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:37245
[junit4] 2> 19068 T64 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 19068 T64 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 19069 T64 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-002
[junit4] 2> 19069 T64 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-002/'
[junit4] 2> 19080 T64 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-002/solr.xml
[junit4] 2> 19108 T64 oasc.CoreContainer.<init> New CoreContainer 270977
[junit4] 2> 19109 T64 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-002/]
[junit4] 2> 19110 T64 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 19110 T64 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 19110 T64 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 19111 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 19111 T64 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 19112 T64 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 19112 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 19112 T64 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 19113 T64 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 19115 T64 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 19116 T64 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 19116 T64 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 19116 T64 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59324/solr
[junit4] 2> 19126 T64 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 19127 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 19128 T86 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b60112 name:ZooKeeperConnection Watcher:127.0.0.1:59324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 19129 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 19134 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 19135 T88 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c753eb name:ZooKeeperConnection Watcher:127.0.0.1:59324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 19135 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 19142 T64 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 19148 T64 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 19152 T64 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 19157 T64 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 19164 T64 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 19174 T64 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 19176 T64 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37245_c_cdz%2Fyr
[junit4] 2> 19178 T64 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37245_c_cdz%2Fyr
[junit4] 2> 19182 T64 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 19184 T64 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 19192 T64 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:37245_c_cdz%2Fyr
[junit4] 2> 19193 T64 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 19196 T64 oasc.Overseer.start Overseer (id=92087814700728324-127.0.0.1:37245_c_cdz%2Fyr-n_0000000000) starting
[junit4] 2> 19205 T64 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 19226 T90 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 19227 T64 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 19230 T64 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 19232 T64 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 19239 T89 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 19261 T91 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 19262 T91 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 19265 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 19265 T91 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 19267 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 19269 T89 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37245/c_cdz/yr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37245_c_cdz%2Fyr",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 19269 T89 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 19276 T89 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 19280 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 19283 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 20266 T91 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 20266 T91 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 20267 T91 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 20268 T91 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 20269 T91 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 20270 T91 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-002/collection1/'
[junit4] 2> 20270 T91 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 20271 T91 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 20271 T91 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 20320 T91 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 20348 T91 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 20350 T91 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 20358 T91 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 20613 T91 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 20615 T91 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 20618 T91 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 20622 T91 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 20661 T91 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 20662 T91 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 20674 T91 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/control/data/
[junit4] 2> 20674 T91 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ce09f2
[junit4] 2> 20678 T91 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/control/data
[junit4] 2> 20679 T91 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/control/data/index/
[junit4] 2> 20679 T91 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 20680 T91 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/control/data/index
[junit4] 2> 20682 T91 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@23d211
[junit4] 2> 22326 T91 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 22327 T91 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 22344 T91 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 22361 T91 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 22362 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 22362 T91 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 22362 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 22362 T91 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 22363 T91 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 22363 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 22364 T91 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 22365 T91 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 22365 T91 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 22366 T91 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 22366 T91 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 22367 T91 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 22367 T91 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 22368 T91 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 22369 T91 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 22371 T91 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 22373 T91 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 22374 T91 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 22375 T91 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=22.23828125, floorSegmentMB=1.3505859375, forceMergeDeletesPctAllowed=12.53813774386405, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 22376 T91 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 22377 T91 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 22377 T91 oass.SolrIndexSearcher.<init> Opening Searcher@d7d0bc[collection1] main
[junit4] 2> 22377 T91 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 22379 T91 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 22379 T91 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 22381 T91 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 22382 T91 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 22382 T91 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 22383 T91 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 22383 T91 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 22384 T91 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 22387 T91 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 22388 T91 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 22388 T91 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 22395 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d7d0bc[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 22401 T91 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 22402 T95 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:37245/c_cdz/yr collection:control_collection shard:shard1
[junit4] 2> 22402 T64 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 22403 T64 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 22408 T95 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 22416 T95 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 22417 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 22418 T97 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@abc359 name:ZooKeeperConnection Watcher:127.0.0.1:59324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 22419 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 22419 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 22419 T95 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 22420 T95 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 22421 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 22421 T64 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C14 name=collection1 org.apache.solr.core.SolrCore@48993c url=https://127.0.0.1:37245/c_cdz/yr/collection1 node=127.0.0.1:37245_c_cdz%2Fyr C14_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:37245/c_cdz/yr, core=collection1, node_name=127.0.0.1:37245_c_cdz%2Fyr}
[junit4] 2> 22422 T95 C14 P37245 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:37245/c_cdz/yr/collection1/
[junit4] 2> 22423 T95 C14 P37245 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 22423 T95 C14 P37245 oasc.SyncStrategy.syncToMe https://127.0.0.1:37245/c_cdz/yr/collection1/ has no replicas
[junit4] 2> 22423 T95 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:37245/c_cdz/yr/collection1/ shard1
[junit4] 2> 22425 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 22426 T95 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 22426 T64 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 22427 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 22427 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 22434 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 22436 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 22440 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 22543 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 22543 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 22591 T95 oasc.ZkController.register We are https://127.0.0.1:37245/c_cdz/yr/collection1/ and leader is https://127.0.0.1:37245/c_cdz/yr/collection1/
[junit4] 2> 22591 T95 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:37245/c_cdz/yr
[junit4] 2> 22592 T95 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 22592 T95 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 22592 T95 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 22594 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 22594 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 22595 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 22595 T95 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 22597 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 22598 T89 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:37245/c_cdz/yr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37245_c_cdz%2Fyr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 22601 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 22704 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 22704 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 22754 T64 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 22755 T64 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 22759 T64 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 22761 T64 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:47515
[junit4] 2> 22763 T64 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 22763 T64 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 22764 T64 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-003
[junit4] 2> 22764 T64 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-003/'
[junit4] 2> 22776 T64 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-003/solr.xml
[junit4] 2> 22808 T64 oasc.CoreContainer.<init> New CoreContainer 23117093
[junit4] 2> 22809 T64 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-003/]
[junit4] 2> 22811 T64 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 22811 T64 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 22816 T64 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 22817 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 22818 T64 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 22818 T64 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 22819 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 22820 T64 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 22820 T64 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 22825 T64 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 22825 T64 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 22826 T64 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 22827 T64 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59324/solr
[junit4] 2> 22827 T64 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 22828 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 22830 T108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f20307 name:ZooKeeperConnection Watcher:127.0.0.1:59324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 22830 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 22833 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 22834 T110 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a511c name:ZooKeeperConnection Watcher:127.0.0.1:59324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 22834 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 22843 T64 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 23847 T64 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47515_c_cdz%2Fyr
[junit4] 2> 23849 T64 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47515_c_cdz%2Fyr
[junit4] 2> 23873 T111 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 23874 T111 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 23876 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 23876 T111 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 23876 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 23877 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 23880 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 23882 T89 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:47515/c_cdz/yr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47515_c_cdz%2Fyr",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 23883 T89 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 23884 T89 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 23889 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 23995 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 23995 T110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 23995 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 24877 T111 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 24878 T111 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 24878 T111 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 24879 T111 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 24880 T111 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 24880 T111 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-003/collection1/'
[junit4] 2> 24881 T111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 24881 T111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 24882 T111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 24931 T111 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 24961 T111 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 24963 T111 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 24971 T111 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 25273 T111 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 25275 T111 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 25277 T111 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 25281 T111 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 25314 T111 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 25315 T111 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 25315 T111 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty1/
[junit4] 2> 25315 T111 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ce09f2
[junit4] 2> 25316 T111 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty1
[junit4] 2> 25317 T111 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty1/index/
[junit4] 2> 25317 T111 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 25318 T111 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty1/index
[junit4] 2> 25318 T111 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1300fb7
[junit4] 2> 25438 T111 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 25438 T111 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 25449 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 25450 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 25450 T111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 25450 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 25451 T111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 25451 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 25452 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 25452 T111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 25453 T111 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 25455 T111 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 25458 T111 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 25459 T111 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 25459 T111 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 25461 T111 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 25462 T111 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 25464 T111 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 25466 T111 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 25470 T111 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 25473 T111 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 25473 T111 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 25476 T111 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=22.23828125, floorSegmentMB=1.3505859375, forceMergeDeletesPctAllowed=12.53813774386405, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 25477 T111 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 25478 T111 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 25478 T111 oass.SolrIndexSearcher.<init> Opening Searcher@19736d4[collection1] main
[junit4] 2> 25479 T111 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 25480 T111 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 25481 T111 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 25481 T111 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 25482 T111 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 25482 T111 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 25484 T111 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 25484 T111 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 25485 T111 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 25485 T111 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 25499 T112 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@19736d4[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 25512 T111 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 25513 T115 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:47515/c_cdz/yr collection:collection1 shard:shard3
[junit4] 2> 25514 T64 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 25514 T64 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 25514 T115 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 25522 T115 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 25524 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25525 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25525 T115 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 25525 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25525 T115 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C15 name=collection1 org.apache.solr.core.SolrCore@67923c url=https://127.0.0.1:47515/c_cdz/yr/collection1 node=127.0.0.1:47515_c_cdz%2Fyr C15_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:47515/c_cdz/yr, core=collection1, node_name=127.0.0.1:47515_c_cdz%2Fyr}
[junit4] 2> 25526 T115 C15 P47515 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:47515/c_cdz/yr/collection1/
[junit4] 2> 25526 T115 C15 P47515 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 25527 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 25527 T115 C15 P47515 oasc.SyncStrategy.syncToMe https://127.0.0.1:47515/c_cdz/yr/collection1/ has no replicas
[junit4] 2> 25527 T115 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:47515/c_cdz/yr/collection1/ shard3
[junit4] 2> 25528 T115 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 25531 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25532 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25533 T110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25532 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25538 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 25542 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25645 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25645 T110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25645 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25688 T115 oasc.ZkController.register We are https://127.0.0.1:47515/c_cdz/yr/collection1/ and leader is https://127.0.0.1:47515/c_cdz/yr/collection1/
[junit4] 2> 25688 T115 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:47515/c_cdz/yr
[junit4] 2> 25689 T115 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 25689 T115 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 25689 T115 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 25691 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25691 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25692 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25692 T115 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 25694 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 25695 T89 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:47515/c_cdz/yr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47515_c_cdz%2Fyr",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 25699 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 25802 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25802 T110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25802 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 25822 T64 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 25823 T64 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 25827 T64 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 25829 T64 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:47144
[junit4] 2> 25831 T64 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 25831 T64 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 25831 T64 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-004
[junit4] 2> 25832 T64 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-004/'
[junit4] 2> 25844 T64 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-004/solr.xml
[junit4] 2> 25873 T64 oasc.CoreContainer.<init> New CoreContainer 7201430
[junit4] 2> 25874 T64 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-004/]
[junit4] 2> 25875 T64 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 25875 T64 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 25876 T64 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 25876 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 25876 T64 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 25877 T64 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 25877 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 25878 T64 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 25878 T64 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 25881 T64 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 25881 T64 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 25882 T64 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 25882 T64 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59324/solr
[junit4] 2> 25882 T64 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 25883 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 25885 T126 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d0c2a name:ZooKeeperConnection Watcher:127.0.0.1:59324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 25885 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 25887 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 25889 T128 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f9ed49 name:ZooKeeperConnection Watcher:127.0.0.1:59324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 25889 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 25896 T64 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 26900 T64 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47144_c_cdz%2Fyr
[junit4] 2> 26903 T64 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47144_c_cdz%2Fyr
[junit4] 2> 26925 T129 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 26926 T129 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 26928 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26928 T129 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 26929 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26930 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26933 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 26935 T89 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:47144/c_cdz/yr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47144_c_cdz%2Fyr",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 26936 T89 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 26936 T89 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 26943 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 27049 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 27049 T110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 27049 T128 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 27049 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 27929 T129 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 27930 T129 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 27931 T129 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 27931 T129 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 27932 T129 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 27932 T129 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-004/collection1/'
[junit4] 2> 27933 T129 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 27934 T129 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 27934 T129 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 27968 T129 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 28005 T129 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 28007 T129 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 28015 T129 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 28251 T129 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 28253 T129 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 28254 T129 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 28258 T129 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 28293 T129 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 28293 T129 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 28294 T129 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty2/
[junit4] 2> 28294 T129 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ce09f2
[junit4] 2> 28295 T129 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty2
[junit4] 2> 28296 T129 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty2/index/
[junit4] 2> 28296 T129 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 28297 T129 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty2/index
[junit4] 2> 28297 T129 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@3e17a5
[junit4] 2> 28308 T129 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 28308 T129 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 28318 T129 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 28318 T129 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 28318 T129 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 28318 T129 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 28319 T129 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 28319 T129 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 28319 T129 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 28320 T129 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 28320 T129 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 28321 T129 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 28322 T129 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 28322 T129 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 28322 T129 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 28323 T129 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 28324 T129 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 28325 T129 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 28326 T129 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 28328 T129 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 28330 T129 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 28330 T129 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 28333 T129 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=22.23828125, floorSegmentMB=1.3505859375, forceMergeDeletesPctAllowed=12.53813774386405, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 28334 T129 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 28334 T129 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 28334 T129 oass.SolrIndexSearcher.<init> Opening Searcher@966dbd[collection1] main
[junit4] 2> 28334 T129 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 28336 T129 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 28336 T129 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 28337 T129 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 28337 T129 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 28338 T129 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 28339 T129 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 28339 T129 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 28339 T129 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 28340 T129 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 28347 T130 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@966dbd[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 28353 T129 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 28353 T133 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:47144/c_cdz/yr collection:collection1 shard:shard2
[junit4] 2> 28354 T64 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 28355 T64 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 28355 T133 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 28362 T133 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 28364 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28364 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28364 T133 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 28364 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28365 T133 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@3e4532 url=https://127.0.0.1:47144/c_cdz/yr/collection1 node=127.0.0.1:47144_c_cdz%2Fyr C16_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:47144/c_cdz/yr, core=collection1, node_name=127.0.0.1:47144_c_cdz%2Fyr}
[junit4] 2> 28365 T133 C16 P47144 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:47144/c_cdz/yr/collection1/
[junit4] 2> 28365 T133 C16 P47144 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 28366 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 28366 T133 C16 P47144 oasc.SyncStrategy.syncToMe https://127.0.0.1:47144/c_cdz/yr/collection1/ has no replicas
[junit4] 2> 28366 T133 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:47144/c_cdz/yr/collection1/ shard2
[junit4] 2> 28367 T133 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 28369 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28372 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28375 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28478 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28478 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28478 T128 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28478 T110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28524 T133 oasc.ZkController.register We are https://127.0.0.1:47144/c_cdz/yr/collection1/ and leader is https://127.0.0.1:47144/c_cdz/yr/collection1/
[junit4] 2> 28524 T133 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:47144/c_cdz/yr
[junit4] 2> 28524 T133 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 28524 T133 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 28525 T133 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 28527 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28527 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28527 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28528 T133 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 28529 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 28530 T89 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:47144/c_cdz/yr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47144_c_cdz%2Fyr",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 28533 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 28635 T110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28635 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28635 T128 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28635 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 28640 T64 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 28641 T64 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 28648 T64 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 28652 T64 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53047
[junit4] 2> 28654 T64 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 28655 T64 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 28655 T64 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-005
[junit4] 2> 28656 T64 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-005/'
[junit4] 2> 28676 T64 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-005/solr.xml
[junit4] 2> 28701 T64 oasc.CoreContainer.<init> New CoreContainer 24573907
[junit4] 2> 28702 T64 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-2BD1265C1938BC74-001/tempDir-005/]
[junit4] 2> 28703 T64 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 28703 T64 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 28703 T64 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 28704 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 28704 T64 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 28704 T64 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 28705 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 28705 T64 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 28705 T64 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 28708 T64 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 28708 T64 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 28709 T64 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 28709 T64 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59324/solr
[junit4] 2> 28709 T64 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 28711 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 28712 T144 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b3c177 name:ZooKeeperConnection Watcher:127.0.0.1:59324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 28713 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 28717 T64 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 28719 T146 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a2e6bb name:ZooKeeperConnection Watcher:127.0.0.1:59324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 28719 T64 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 28734 T64 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 29741 T64 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53047_c_cdz%2Fyr
[junit4] 2> 29744 T64 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53047_c_cdz%2Fyr
[junit4] 2> 29766 T147 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 29766 T147 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 29769 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29769 T147 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 29769 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29770 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29774 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 29776 T89 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53047/c_cdz/yr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53047_c_cdz%2Fyr",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 29776 T89 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 29777 T89 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 29783 T88 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29887 T97 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 29888 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 29888 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 29888 T128 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 29888 T110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 30770 T147 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collect
[...truncated too long message...]
85) Thread[id=1052, name=searcherExecutor-487-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 86) Thread[id=1005, name=Thread-177-SendThread(127.0.0.1:59324), state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2> 87) Thread[id=892, name=Thread-451, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:503)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:841)
[junit4] 2> 88) Thread[id=974, name=qtp33154440-974 Selector1, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.nio.ch.IOUtil.drain(Native Method)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:90)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] 2> at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:106)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:536)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 89) Thread[id=118, name=qtp11935889-118 Selector1, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
[junit4] 2> at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] 2> at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:106)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:536)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 7242107 T1027 oaz.ClientCnxn$SendThread.run WARN Session 0x14729612b610055 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
[junit4] 2>
[junit4] 2> 7242107 T886 oaz.ClientCnxn$SendThread.run WARN Session 0x14729612b610049 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=it, timezone=Greenwich
[junit4] 2> NOTE: Linux 3.8.0-42-generic i386/Oracle Corporation 1.7.0_60 (32-bit)/cpus=8,threads=105,free=158842152,total=493879296
[junit4] 2> NOTE: All tests run in this JVM: [CopyFieldTest, ModifyConfFileTest, TestFieldCollectionResource, QueryElevationComponentTest, ChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=2BD1265C1938BC74 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=it -Dtests.timezone=Greenwich -Dtests.file.encoding=ISO-8859-1
[junit4] 2> 7242108 T1005 oaz.ClientCnxn$SendThread.run WARN Session 0x14729612b610053 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
[junit4] 2>
[junit4] ERROR 0.00s J1 | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([2BD1265C1938BC74]:0)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=337, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] > Caused by: java.lang.AssertionError: liveDocs.count()=2 info.docCount=5 info.getDelCount()=4
[junit4] > at __randomizedtesting.SeedInfo.seed([2BD1265C1938BC74]:0)
[junit4] > at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
[junit4] > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:115)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:133)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:185)
[junit4] > at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:95)
[junit4] > at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:393)
[junit4] > at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:269)
[junit4] > at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:204)
[junit4] > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1489)
[junit4] > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1690)
[junit4] > at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:673)
[junit4] > at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:493)
[junit4] > at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:337)
[junit4] > at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:163)
[junit4] > at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:447)
[junit4] > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)
[junit4] Completed on J1 in 7225.18s, 1 test, 3 errors <<< FAILURES!
[...truncated 313 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 418 suites, 1710 tests, 2 suite-level errors, 1 error, 378 ignored (16 assumptions)
Total time: 157 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_60 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_60) - Build #
10792 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10792/
Java: 32bit/jdk1.7.0_60 -client -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
at __randomizedtesting.SeedInfo.seed([9041240C5B05D6E0:11A7AA142C5AB6DC]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:659)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1142)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1111)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11349 lines...]
[junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/init-core-data-001
[junit4] 2> 887834 T4480 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 887835 T4480 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_q/v
[junit4] 2> 887838 T4480 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 887838 T4480 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 887839 T4481 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 887939 T4480 oasc.ZkTestServer.run start zk server on port:59511
[junit4] 2> 887940 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 887943 T4487 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e6b5c4 name:ZooKeeperConnection Watcher:127.0.0.1:59511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 887943 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 887944 T4480 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 887949 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 887950 T4489 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d0931 name:ZooKeeperConnection Watcher:127.0.0.1:59511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 887950 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 887951 T4480 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 887955 T4480 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 887958 T4480 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 887961 T4480 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 887964 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 887965 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 887969 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 887970 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 887974 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 887974 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 887977 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 887978 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 887981 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 887982 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 887985 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 887985 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 887988 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 887989 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 887992 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 887992 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 887995 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 887996 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 887999 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 888000 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 888003 T4480 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 888004 T4480 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 888265 T4480 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 888268 T4480 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56004
[junit4] 2> 888268 T4480 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 888269 T4480 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 888269 T4480 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-002
[junit4] 2> 888270 T4480 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-002/'
[junit4] 2> 888287 T4480 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-002/solr.xml
[junit4] 2> 888315 T4480 oasc.CoreContainer.<init> New CoreContainer 1104932
[junit4] 2> 888315 T4480 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-002/]
[junit4] 2> 888316 T4480 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 888316 T4480 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 888316 T4480 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 888317 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 888317 T4480 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 888317 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 888318 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 888318 T4480 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 888318 T4480 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 888319 T4480 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 888319 T4480 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 888319 T4480 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 888320 T4480 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59511/solr
[junit4] 2> 888320 T4480 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 888321 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 888322 T4500 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e4c9c6 name:ZooKeeperConnection Watcher:127.0.0.1:59511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 888323 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 888325 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 888326 T4502 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a1acbe name:ZooKeeperConnection Watcher:127.0.0.1:59511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 888326 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 888328 T4480 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 888332 T4480 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 888336 T4480 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 888340 T4480 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 888342 T4480 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 888361 T4480 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 888363 T4480 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56004__q%2Fv
[junit4] 2> 888365 T4480 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56004__q%2Fv
[junit4] 2> 888369 T4480 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 888372 T4480 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 888377 T4480 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56004__q%2Fv
[junit4] 2> 888377 T4480 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 888379 T4480 oasc.Overseer.start Overseer (id=92087344733356035-127.0.0.1:56004__q%2Fv-n_0000000000) starting
[junit4] 2> 888382 T4480 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 888392 T4504 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 888393 T4480 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 888396 T4480 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 888398 T4480 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 888401 T4503 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 888404 T4505 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 888404 T4505 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 888405 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 888405 T4505 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 888406 T4503 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 888406 T4503 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56004/_q/v",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56004__q%2Fv",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 888406 T4503 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 888407 T4503 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 888408 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 888408 T4502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 889405 T4505 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 889406 T4505 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 889407 T4505 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 889407 T4505 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 889408 T4505 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 889408 T4505 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-002/collection1/'
[junit4] 2> 889409 T4505 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 889409 T4505 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 889409 T4505 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 889448 T4505 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 889475 T4505 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 889477 T4505 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 889493 T4505 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 889726 T4505 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 889731 T4505 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 889733 T4505 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 889743 T4505 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 889746 T4505 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 889748 T4505 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 889749 T4505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 889749 T4505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 889749 T4505 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 889750 T4505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 889750 T4505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 889750 T4505 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 889750 T4505 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 889750 T4505 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/control/data/
[junit4] 2> 889751 T4505 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b72f5
[junit4] 2> 889751 T4505 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/control/data
[junit4] 2> 889751 T4505 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/control/data/index/
[junit4] 2> 889752 T4505 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 889752 T4505 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/control/data/index
[junit4] 2> 889752 T4505 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.360968599084729]
[junit4] 2> 889753 T4505 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@c2d5a7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a78660),segFN=segments_1,generation=1}
[junit4] 2> 889753 T4505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 889755 T4505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 889756 T4505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 889756 T4505 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 889756 T4505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 889756 T4505 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 889757 T4505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 889757 T4505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 889757 T4505 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 889757 T4505 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 889758 T4505 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 889758 T4505 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 889758 T4505 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 889759 T4505 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 889759 T4505 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 889759 T4505 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 889760 T4505 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 889760 T4505 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 889762 T4505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 889764 T4505 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 889765 T4505 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 889765 T4505 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=1.5029296875, floorSegmentMB=0.3759765625, forceMergeDeletesPctAllowed=24.414295586335726, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 889766 T4505 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@c2d5a7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a78660),segFN=segments_1,generation=1}
[junit4] 2> 889766 T4505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 889766 T4505 oass.SolrIndexSearcher.<init> Opening Searcher@1b10bb3[collection1] main
[junit4] 2> 889766 T4505 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 889767 T4505 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 889767 T4505 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 889768 T4505 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 889768 T4505 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 889768 T4505 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 889769 T4505 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 889769 T4505 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 889770 T4505 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 889771 T4505 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 889771 T4505 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 889771 T4505 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 889774 T4506 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b10bb3[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 889775 T4505 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 889775 T4509 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56004/_q/v collection:control_collection shard:shard1
[junit4] 2> 889776 T4480 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 889776 T4509 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 889776 T4480 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 889778 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 889778 T4511 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a775f7 name:ZooKeeperConnection Watcher:127.0.0.1:59511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 889779 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 889780 T4480 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 889780 T4509 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 889781 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 889781 T4509 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 889782 T4509 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 889781 T4480 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 889782 T4503 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C867 name=collection1 org.apache.solr.core.SolrCore@52decd url=http://127.0.0.1:56004/_q/v/collection1 node=127.0.0.1:56004__q%2Fv C867_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:56004/_q/v, core=collection1, node_name=127.0.0.1:56004__q%2Fv}
[junit4] 2> 889782 T4509 C867 P56004 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56004/_q/v/collection1/
[junit4] 2> 889783 T4509 C867 P56004 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 889783 T4509 C867 P56004 oasc.SyncStrategy.syncToMe http://127.0.0.1:56004/_q/v/collection1/ has no replicas
[junit4] 2> 889783 T4509 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56004/_q/v/collection1/ shard1
[junit4] 2> 889783 T4509 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 889784 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 889786 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 889787 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 889889 T4502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 889889 T4511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 889937 T4509 oasc.ZkController.register We are http://127.0.0.1:56004/_q/v/collection1/ and leader is http://127.0.0.1:56004/_q/v/collection1/
[junit4] 2> 889937 T4509 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56004/_q/v
[junit4] 2> 889937 T4509 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 889937 T4509 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 889937 T4509 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 889939 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 889939 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 889939 T4509 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 889939 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 889940 T4503 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 889941 T4503 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:56004/_q/v",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56004__q%2Fv",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 889942 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 890043 T4502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 890043 T4511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 890110 T4480 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 890111 T4480 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 890116 T4480 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60392
[junit4] 2> 890117 T4480 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 890117 T4480 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 890118 T4480 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-003
[junit4] 2> 890118 T4480 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-003/'
[junit4] 2> 890137 T4480 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-003/solr.xml
[junit4] 2> 890183 T4480 oasc.CoreContainer.<init> New CoreContainer 6667635
[junit4] 2> 890184 T4480 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-003/]
[junit4] 2> 890185 T4480 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 890185 T4480 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 890185 T4480 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 890186 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 890186 T4480 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 890187 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 890187 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 890188 T4480 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 890188 T4480 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 890189 T4480 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 890190 T4480 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 890190 T4480 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 890191 T4480 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59511/solr
[junit4] 2> 890191 T4480 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 890192 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 890193 T4522 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@178ce5a name:ZooKeeperConnection Watcher:127.0.0.1:59511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 890194 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 890197 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 890198 T4524 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a1ce5e name:ZooKeeperConnection Watcher:127.0.0.1:59511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 890198 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 890202 T4480 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 891204 T4480 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60392__q%2Fv
[junit4] 2> 891205 T4480 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60392__q%2Fv
[junit4] 2> 891212 T4525 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 891213 T4525 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 891213 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 891213 T4525 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 891214 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 891214 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 891215 T4503 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 891215 T4503 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60392/_q/v",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60392__q%2Fv",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 891215 T4503 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 891216 T4503 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 891217 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 891319 T4511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 891319 T4524 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 891319 T4502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 892214 T4525 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 892214 T4525 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 892215 T4525 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 892215 T4525 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 892216 T4525 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 892216 T4525 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-003/collection1/'
[junit4] 2> 892217 T4525 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 892218 T4525 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 892218 T4525 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 892268 T4525 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 892323 T4525 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 892324 T4525 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 892335 T4525 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 892581 T4525 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 892586 T4525 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 892588 T4525 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 892596 T4525 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 892599 T4525 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 892602 T4525 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 892602 T4525 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 892603 T4525 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 892603 T4525 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 892603 T4525 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 892604 T4525 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 892604 T4525 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 892604 T4525 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 892604 T4525 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty1/
[junit4] 2> 892605 T4525 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b72f5
[junit4] 2> 892605 T4525 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty1
[junit4] 2> 892605 T4525 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty1/index/
[junit4] 2> 892606 T4525 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 892606 T4525 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty1/index
[junit4] 2> 892606 T4525 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.360968599084729]
[junit4] 2> 892607 T4525 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5461c5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a0176c),segFN=segments_1,generation=1}
[junit4] 2> 892607 T4525 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 892610 T4525 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 892610 T4525 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 892611 T4525 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 892611 T4525 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 892611 T4525 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 892611 T4525 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 892612 T4525 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 892612 T4525 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 892612 T4525 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 892613 T4525 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 892613 T4525 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 892613 T4525 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 892613 T4525 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 892614 T4525 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 892614 T4525 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 892615 T4525 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 892615 T4525 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 892618 T4525 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 892620 T4525 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 892620 T4525 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 892621 T4525 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=1.5029296875, floorSegmentMB=0.3759765625, forceMergeDeletesPctAllowed=24.414295586335726, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 892621 T4525 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5461c5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a0176c),segFN=segments_1,generation=1}
[junit4] 2> 892621 T4525 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 892622 T4525 oass.SolrIndexSearcher.<init> Opening Searcher@fd5cc6[collection1] main
[junit4] 2> 892622 T4525 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 892622 T4525 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 892623 T4525 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 892623 T4525 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 892623 T4525 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 892624 T4525 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 892624 T4525 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 892624 T4525 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 892625 T4525 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 892625 T4525 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 892628 T4526 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fd5cc6[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 892631 T4525 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 892631 T4529 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60392/_q/v collection:collection1 shard:shard1
[junit4] 2> 892632 T4480 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 892632 T4480 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 892632 T4529 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 892636 T4529 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 892637 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892637 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892637 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892638 T4529 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 892638 T4529 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 892639 T4503 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C868 name=collection1 org.apache.solr.core.SolrCore@1628d20 url=http://127.0.0.1:60392/_q/v/collection1 node=127.0.0.1:60392__q%2Fv C868_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:60392/_q/v, core=collection1, node_name=127.0.0.1:60392__q%2Fv}
[junit4] 2> 892639 T4529 C868 P60392 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60392/_q/v/collection1/
[junit4] 2> 892639 T4529 C868 P60392 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 892639 T4529 C868 P60392 oasc.SyncStrategy.syncToMe http://127.0.0.1:60392/_q/v/collection1/ has no replicas
[junit4] 2> 892640 T4529 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60392/_q/v/collection1/ shard1
[junit4] 2> 892640 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892640 T4529 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 892644 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892647 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892748 T4502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 892748 T4511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 892748 T4524 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 892796 T4529 oasc.ZkController.register We are http://127.0.0.1:60392/_q/v/collection1/ and leader is http://127.0.0.1:60392/_q/v/collection1/
[junit4] 2> 892796 T4529 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60392/_q/v
[junit4] 2> 892796 T4529 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 892797 T4529 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 892797 T4529 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 892798 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892798 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892798 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892799 T4529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 892799 T4503 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 892800 T4503 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:60392/_q/v",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60392__q%2Fv",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 892803 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 892904 T4480 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 892904 T4480 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 892905 T4511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 892905 T4502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 892905 T4524 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 892906 T4480 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60994
[junit4] 2> 892907 T4480 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 892907 T4480 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 892907 T4480 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-004
[junit4] 2> 892908 T4480 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-004/'
[junit4] 2> 892920 T4480 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-004/solr.xml
[junit4] 2> 892948 T4480 oasc.CoreContainer.<init> New CoreContainer 424761
[junit4] 2> 892949 T4480 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-004/]
[junit4] 2> 892950 T4480 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 892950 T4480 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 892950 T4480 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 892950 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 892951 T4480 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 892951 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 892951 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 892952 T4480 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 892952 T4480 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 892953 T4480 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 892953 T4480 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 892953 T4480 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 892954 T4480 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59511/solr
[junit4] 2> 892954 T4480 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 892955 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 892956 T4540 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18416b1 name:ZooKeeperConnection Watcher:127.0.0.1:59511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 892956 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 892958 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 892959 T4542 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d80da name:ZooKeeperConnection Watcher:127.0.0.1:59511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 892959 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 892965 T4480 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 893969 T4480 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60994__q%2Fv
[junit4] 2> 893971 T4480 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60994__q%2Fv
[junit4] 2> 893985 T4543 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 893986 T4543 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 893987 T4543 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 893987 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 893988 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 893988 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 893990 T4503 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 893991 T4503 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60994/_q/v",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60994__q%2Fv",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 893991 T4503 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 893992 T4503 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 893995 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 894097 T4542 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 894098 T4502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 894097 T4524 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 894097 T4511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 894988 T4543 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 894988 T4543 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 894989 T4543 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 894990 T4543 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 894992 T4543 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 894992 T4543 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-004/collection1/'
[junit4] 2> 894993 T4543 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 894994 T4543 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 894994 T4543 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 895037 T4543 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 895065 T4543 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 895066 T4543 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 895074 T4543 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 895335 T4543 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 895340 T4543 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 895342 T4543 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 895350 T4543 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 895353 T4543 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 895355 T4543 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 895356 T4543 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 895356 T4543 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 895357 T4543 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 895357 T4543 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 895358 T4543 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 895358 T4543 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 895358 T4543 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 895358 T4543 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty2/
[junit4] 2> 895358 T4543 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b72f5
[junit4] 2> 895359 T4543 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty2
[junit4] 2> 895359 T4543 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty2/index/
[junit4] 2> 895359 T4543 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 895360 T4543 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty2/index
[junit4] 2> 895360 T4543 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.360968599084729]
[junit4] 2> 895361 T4543 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5ac004 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@92e453),segFN=segments_1,generation=1}
[junit4] 2> 895361 T4543 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 895365 T4543 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 895365 T4543 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 895365 T4543 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 895366 T4543 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 895366 T4543 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 895366 T4543 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 895366 T4543 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 895367 T4543 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 895367 T4543 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 895367 T4543 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 895368 T4543 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 895369 T4543 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 895369 T4543 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 895370 T4543 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 895370 T4543 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 895371 T4543 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 895371 T4543 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 895374 T4543 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 895376 T4543 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 895377 T4543 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 895377 T4543 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=1.5029296875, floorSegmentMB=0.3759765625, forceMergeDeletesPctAllowed=24.414295586335726, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 895378 T4543 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5ac004 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@92e453),segFN=segments_1,generation=1}
[junit4] 2> 895378 T4543 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 895378 T4543 oass.SolrIndexSearcher.<init> Opening Searcher@185600d[collection1] main
[junit4] 2> 895379 T4543 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 895380 T4543 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 895380 T4543 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 895381 T4543 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 895381 T4543 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 895381 T4543 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 895382 T4543 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 895382 T4543 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 895382 T4543 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 895382 T4543 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 895386 T4544 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@185600d[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 895388 T4543 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 895389 T4547 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60994/_q/v collection:collection1 shard:shard1
[junit4] 2> 895389 T4480 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 895390 T4480 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 895391 T4547 oasc.ZkController.register We are http://127.0.0.1:60994/_q/v/collection1/ and leader is http://127.0.0.1:60392/_q/v/collection1/
[junit4] 2> 895391 T4547 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60994/_q/v
[junit4] 2> 895391 T4547 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 895391 T4547 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C869 name=collection1 org.apache.solr.core.SolrCore@19739dd url=http://127.0.0.1:60994/_q/v/collection1 node=127.0.0.1:60994__q%2Fv C869_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:60994/_q/v, core=collection1, node_name=127.0.0.1:60994__q%2Fv}
[junit4] 2> 895392 T4548 C869 P60994 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 895392 T4547 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 895392 T4548 C869 P60994 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 895392 T4548 C869 P60994 oasc.RecoveryStrategy.doRecovery Publishing state of core collection1 as recovering, leader is http://127.0.0.1:60392/_q/v/collection1/ and I am http://127.0.0.1:60994/_q/v/collection1/
[junit4] 2> 895393 T4548 C869 P60994 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 895393 T4548 C869 P60994 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 895393 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 895394 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 895394 T4548 C869 P60994 oasc.RecoveryStrategy.sendPrepRecoveryCmd Sending prep recovery command to http://127.0.0.1:60392/_q/v; WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1%3A60994__q%252Fv&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true
[junit4] 2> 895394 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 895395 T4503 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 895395 T4520 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 895395 T4503 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "base_url":"http://127.0.0.1:60994/_q/v",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60994__q%2Fv",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 895396 T4520 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 895396 T4520 oasha.CoreAdminHandler.handleWaitForStateAction Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 895396 T4520 oasha.CoreAdminHandler.handleWaitForStateAction In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:60994__q%2Fv, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"state":"down","base_url":"http://127.0.0.1:60994/_q/v","core":"collection1","node_name":"127.0.0.1:60994__q%2Fv"}
[junit4] 2> 895397 T4502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 895499 T4511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 895499 T4524 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 895499 T4502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 895499 T4542 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 895648 T4480 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 895649 T4480 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 895651 T4480 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59338
[junit4] 2> 895652 T4480 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 895653 T4480 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 895654 T4480 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-005
[junit4] 2> 895654 T4480 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-005/'
[junit4] 2> 895678 T4480 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-005/solr.xml
[junit4] 2> 895707 T4480 oasc.CoreContainer.<init> New CoreContainer 15823243
[junit4] 2> 895708 T4480 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-005/]
[junit4] 2> 895708 T4480 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 895709 T4480 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 895709 T4480 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 895709 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 895710 T4480 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 895710 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 895710 T4480 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 895711 T4480 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 895711 T4480 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 895711 T4480 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 895712 T4480 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 895712 T4480 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 895713 T4480 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59511/solr
[junit4] 2> 895713 T4480 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 895714 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 895715 T4560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1559dc9 name:ZooKeeperConnection Watcher:127.0.0.1:59511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 895716 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 895717 T4480 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 895718 T4562 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35a1e7 name:ZooKeeperConnection Watcher:127.0.0.1:59511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 895718 T4480 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 895726 T4480 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 896397 T4520 oasha.CoreAdminHandler.handleWaitForStateAction In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:60994__q%2Fv, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"state":"recovering","base_url":"http://127.0.0.1:60994/_q/v","core":"collection1","node_name":"127.0.0.1:60994__q%2Fv"}
[junit4] 2> 896398 T4520 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 896399 T4520 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={version=2&onlyIfLeader=true&action=PREPRECOVERY&nodeName=127.0.0.1:60994__q%252Fv&coreNodeName=core_node2&onlyIfLeaderActive=true&checkLive=true&state=recovering&core=collection1&wt=javabin} status=0 QTime=1004
[junit4] 2> 896729 T4480 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59338__q%2Fv
[junit4] 2> 896731 T4480 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59338__q%2Fv
[junit4] 2> 896745 T4563 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 896745 T4563 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 896746 T4502 oasc.Dist
[...truncated too long message...]
space/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001/tempDir-001/jetty4
[junit4] 2> 942966 T4583 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:243)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:346)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:330)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:198)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:452)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:216)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:452)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:216)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:452)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:216)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 942968 T4583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 942968 T4583 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 942968 T4583 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 942969 T4583 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.SyncSliceTest-9041240C5B05D6E0-001
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=es_GT, timezone=US/Arizona
[junit4] 2> NOTE: Linux 3.8.0-42-generic i386/Oracle Corporation 1.7.0_60 (32-bit)/cpus=8,threads=1,free=146267272,total=300417024
[junit4] 2> NOTE: All tests run in this JVM: [DocExpirationUpdateProcessorFactoryTest, PrimitiveFieldTypeTest, TestTolerantSearch, HighlighterMaxOffsetTest, TestLMDirichletSimilarityFactory, TestCoreDiscovery, TestStressReorder, RAMDirectoryFactoryTest, ReturnFieldsTest, SolrCmdDistributorTest, TestOverriddenPrefixQueryForCustomFieldType, HighlighterTest, TestDocBasedVersionConstraints, TestFaceting, ShardRoutingTest, DisMaxRequestHandlerTest, ResponseHeaderTest, TestSchemaResource, BasicDistributedZkTest, OverseerCollectionProcessorTest, TestWordDelimiterFilterFactory, WordBreakSolrSpellCheckerTest, TestConfigSets, StandardRequestHandlerTest, HdfsCollectionsAPIDistributedZkTest, DirectSolrSpellCheckerTest, HdfsBasicDistributedZkTest, TestCloudInspectUtil, PrimUtilsTest, TestFieldTypeCollectionResource, TestUtils, TestDFRSimilarityFactory, TestBinaryResponseWriter, TestConfig, OpenExchangeRatesOrgProviderTest, ZkControllerTest, TestHighlightDedupGrouping, RequiredFieldsTest, FieldFacetExtrasTest, StatelessScriptUpdateProcessorFactoryTest, TestSearchPerf, MBeansHandlerTest, BadCopyFieldTest, TestTrie, TestDistributedSearch, DocValuesMultiTest, TestSort, EchoParamsTest, TestCodecSupport, SuggesterTest, LeaderElectionTest, ZkCLITest, UnloadDistributedZkTest, QueryFacetTest, TestAnalyzedSuggestions, BadIndexSchemaTest, AnalyticsQueryTest, TestFastLRUCache, TriLevelCompositeIdRoutingTest, FieldFacetTest, TestLeaderElectionZkExpiry, FieldMutatingUpdateProcessorTest, CustomCollectionTest, SuggestComponentTest, HdfsLockFactoryTest, SpellingQueryConverterTest, TestDefaultSimilarityFactory, MoreLikeThisHandlerTest, TestComplexPhraseQParserPlugin, TestAnalyzeInfixSuggestions, TestSolrCoreProperties, TestJmxIntegration, TestHashPartitioner, HighlighterConfigTest, ResponseLogComponentTest, TestComponentsName, TestReplicationHandler, TestExceedMaxTermLength, TestSearcherReuse, TestFuzzyAnalyzedSuggestions, TestRemoteStreaming, QueryEqualityTest, SpellCheckComponentTest, BlockCacheTest, TestSolrIndexConfig, ClusterStateUpdateTest, SolrIndexSplitterTest, TestLMJelinekMercerSimilarityFactory, TestFastOutputStream, TestInitQParser, TestSolrDeletionPolicy2, SolrCoreCheckLockOnStartupTest, TestSchemaVersionResource, TimeZoneUtilsTest, CurrencyFieldOpenExchangeTest, TestSolrXmlPersistence, TestReRankQParserPlugin, TestPartialUpdateDeduplication, AbstractAnalyticsStatsTest, TestRandomDVFaceting, HttpPartitionTest, TestFoldingMultitermQuery, BasicDistributedZk2Test, SyncSliceTest]
[junit4] Completed on J0 in 55.33s, 1 test, 1 error <<< FAILURES!
[...truncated 641 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 418 suites, 1710 tests, 1 error, 38 ignored (17 assumptions)
Total time: 71 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_60 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any