You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/07 00:10:20 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-fcs-b128) - Build #
9281 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9281/
Java: 32bit/jdk1.8.0-fcs-b128 -server -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
deletealias the collection time out:60s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: deletealias the collection time out:60s
at __randomizedtesting.SeedInfo.seed([6A1A0CE882B7C6EA:EBFC82F0F5E8A6D6]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.client.solrj.request.CollectionAdminRequest.process(CollectionAdminRequest.java:271)
at org.apache.solr.client.solrj.request.CollectionAdminRequest.deleteAlias(CollectionAdminRequest.java:402)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testSolrJAPICalls(CollectionsAPIDistributedZkTest.java:305)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:200)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10482 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 745410 T2967 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 745414 T2967 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1391727576146
[junit4] 2> 745415 T2967 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 745416 T2968 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 745516 T2967 oasc.ZkTestServer.run start zk server on port:42866
[junit4] 2> 745517 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745652 T2974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@958118 name:ZooKeeperConnection Watcher:127.0.0.1:42866 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745653 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745653 T2967 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 745657 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745658 T2976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bfef07 name:ZooKeeperConnection Watcher:127.0.0.1:42866/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745658 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745658 T2967 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 745667 T2967 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 745669 T2967 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 745670 T2967 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 745672 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 745672 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 745675 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 745676 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 745678 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 745679 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 745681 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 745681 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 745683 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 745683 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 745685 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 745685 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 745689 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 745690 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 745692 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 745693 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 745694 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 745695 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 745697 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 745697 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 745699 T2967 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 745699 T2967 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using new style solr.xml
[junit4] 2> 745771 T2967 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 745776 T2967 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57059
[junit4] 2> 745777 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 745777 T2967 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 745778 T2967 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432
[junit4] 2> 745778 T2967 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/'
[junit4] 2> 745789 T2967 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/solr.xml
[junit4] 2> 745797 T2967 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 745797 T2967 oasc.CoreContainer.<init> New CoreContainer 24487667
[junit4] 2> 745798 T2967 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/]
[junit4] 2> 745798 T2967 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 745798 T2967 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 745799 T2967 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 745799 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 745799 T2967 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 745800 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 745800 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 745800 T2967 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 745801 T2967 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 745803 T2967 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 745803 T2967 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 745803 T2967 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 745804 T2967 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:42866/solr
[junit4] 2> 745804 T2967 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 745805 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745806 T2987 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@583f8 name:ZooKeeperConnection Watcher:127.0.0.1:42866 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745806 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745808 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745808 T2989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f79eaf name:ZooKeeperConnection Watcher:127.0.0.1:42866/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745809 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745810 T2967 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 745811 T2967 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 745813 T2967 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 745814 T2967 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57059_
[junit4] 2> 745815 T2967 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57059_
[junit4] 2> 745817 T2967 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 745818 T2967 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 745824 T2967 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:57059_
[junit4] 2> 745825 T2967 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 745826 T2967 oasc.Overseer.start Overseer (id=91208258430435331-127.0.0.1:57059_-n_0000000000) starting
[junit4] 2> 745828 T2967 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 745830 T2991 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 745830 T2967 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 745832 T2991 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 745833 T2967 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 745834 T2967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 745843 T2990 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 745843 T2967 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432
[junit4] 2> 745845 T2967 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/conf/
[junit4] 2> 745884 T2967 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 745885 T2967 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 745885 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 745886 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 745888 T2994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64a110 name:ZooKeeperConnection Watcher:127.0.0.1:42866/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 745888 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 745889 T2967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 745898 T2967 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 745991 T2967 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 745992 T2967 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 745994 T2967 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45700
[junit4] 2> 745995 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 745995 T2967 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 745995 T2967 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391727576629
[junit4] 2> 745996 T2967 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391727576629/'
[junit4] 2> 746006 T2967 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391727576629/solr.xml
[junit4] 2> 746014 T2967 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 746015 T2967 oasc.CoreContainer.<init> New CoreContainer 24161524
[junit4] 2> 746015 T2967 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391727576629/]
[junit4] 2> 746016 T2967 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 746016 T2967 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 746016 T2967 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 746017 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 746017 T2967 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 746017 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 746017 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 746018 T2967 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 746018 T2967 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 746020 T2967 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 746020 T2967 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 746021 T2967 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 746021 T2967 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:42866/solr
[junit4] 2> 746021 T2967 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 746022 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 746023 T3005 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@649399 name:ZooKeeperConnection Watcher:127.0.0.1:42866 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 746024 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 746025 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 746026 T3007 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17682cf name:ZooKeeperConnection Watcher:127.0.0.1:42866/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 746026 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 746028 T2967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 747038 T2967 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45700_
[junit4] 2> 747039 T2967 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45700_
[junit4] 2> 747042 T2989 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 747042 T2994 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 747042 T3007 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 747045 T2967 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391727576629
[junit4] 2> 747046 T2967 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391727576629/conf/
[junit4] 2> 747092 T2967 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 747093 T2967 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 747093 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 747161 T2967 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 747162 T2967 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 747164 T2967 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51738
[junit4] 2> 747165 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 747165 T2967 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 747166 T2967 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825
[junit4] 2> 747166 T2967 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/'
[junit4] 2> 747176 T2967 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solr.xml
[junit4] 2> 747187 T2967 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 747188 T2967 oasc.CoreContainer.<init> New CoreContainer 20320719
[junit4] 2> 747188 T2967 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/]
[junit4] 2> 747189 T2967 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 747189 T2967 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 747189 T2967 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 747190 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 747190 T2967 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 747190 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 747191 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 747191 T2967 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 747191 T2967 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 747194 T2967 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 747195 T2967 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 747195 T2967 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 747196 T2967 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:42866/solr
[junit4] 2> 747196 T2967 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 747197 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 747200 T3019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1396e85 name:ZooKeeperConnection Watcher:127.0.0.1:42866 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 747200 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 747202 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 747204 T3021 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c3b3c name:ZooKeeperConnection Watcher:127.0.0.1:42866/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 747205 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 747209 T2967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 748216 T2967 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51738_
[junit4] 2> 748217 T2967 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51738_
[junit4] 2> 748220 T2989 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 748220 T2994 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 748220 T3007 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 748220 T3021 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 748223 T2967 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825
[junit4] 2> 748224 T2967 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/conf/
[junit4] 2> 748256 T2967 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 748257 T2967 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 748257 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 748343 T2967 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 748344 T2967 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 748346 T2967 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41285
[junit4] 2> 748347 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 748347 T2967 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 748348 T2967 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988
[junit4] 2> 748348 T2967 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/'
[junit4] 2> 748361 T2967 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/solr.xml
[junit4] 2> 748371 T2967 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 748372 T2967 oasc.CoreContainer.<init> New CoreContainer 20225775
[junit4] 2> 748372 T2967 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/]
[junit4] 2> 748372 T2967 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 748373 T2967 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 748373 T2967 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 748373 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 748374 T2967 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 748374 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 748374 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 748375 T2967 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 748375 T2967 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 748379 T2967 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 748380 T2967 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 748380 T2967 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 748381 T2967 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:42866/solr
[junit4] 2> 748381 T2967 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 748382 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 748383 T3033 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@805fa1 name:ZooKeeperConnection Watcher:127.0.0.1:42866 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 748383 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 748385 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 748386 T3035 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1051c98 name:ZooKeeperConnection Watcher:127.0.0.1:42866/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 748387 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 748389 T2967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 749391 T2967 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41285_
[junit4] 2> 749392 T2967 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41285_
[junit4] 2> 749394 T3021 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 749395 T2989 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 749395 T2994 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 749395 T3035 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 749395 T3007 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 749399 T2967 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988
[junit4] 2> 749401 T2967 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/conf/
[junit4] 2> 749431 T2967 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 749432 T2967 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 749432 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 749514 T2967 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 749515 T2967 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 749517 T2967 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40596
[junit4] 2> 749517 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 749518 T2967 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 749518 T2967 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164
[junit4] 2> 749518 T2967 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/'
[junit4] 2> 749532 T2967 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/solr.xml
[junit4] 2> 749540 T2967 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 749540 T2967 oasc.CoreContainer.<init> New CoreContainer 28876362
[junit4] 2> 749540 T2967 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/]
[junit4] 2> 749541 T2967 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 749541 T2967 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 749542 T2967 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 749542 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 749542 T2967 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 749543 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 749543 T2967 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 749543 T2967 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 749543 T2967 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 749545 T2967 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 749545 T2967 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 749546 T2967 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 749546 T2967 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:42866/solr
[junit4] 2> 749546 T2967 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 749547 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 749548 T3047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cc44d3 name:ZooKeeperConnection Watcher:127.0.0.1:42866 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 749548 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 749550 T2967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 749551 T3049 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cf9629 name:ZooKeeperConnection Watcher:127.0.0.1:42866/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 749551 T2967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 749553 T2967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 750555 T2967 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40596_
[junit4] 2> 750557 T2967 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40596_
[junit4] 2> 750560 T2994 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750560 T2989 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750560 T3007 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750560 T3035 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750560 T3021 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750561 T3049 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 750563 T2967 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164
[junit4] 2> 750564 T2967 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/conf/
[junit4] 2> 750597 T2967 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 750597 T2967 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 750598 T2967 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 750601 T3001 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&router.name=compositeId&action=CREATE&numShards=2&wt=javabin&version=2
[junit4] 2> 750602 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 750603 T2991 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 750603 T2991 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 750603 T2991 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 750603 T2991 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 750608 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 750609 T2990 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 750609 T2990 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 750610 T2990 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 750611 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 750611 T3049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750611 T3035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750611 T2994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750611 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750611 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750611 T3007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750708 T2991 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 750708 T2991 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:57059_
[junit4] 2> 750709 T2991 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:51738_
[junit4] 2> 750709 T2991 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:40596_
[junit4] 2> 750710 T2991 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:41285_
[junit4] 2> 750720 T2984 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
[junit4] 2> 750720 T3042 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
[junit4] 2> 750720 T3016 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
[junit4] 2> 750721 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 750721 T2984 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 750722 T3016 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 750722 T3042 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 750722 T3030 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
[junit4] 2> 750723 T2990 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 750724 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 750724 T2990 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:57059",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57059_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 750724 T3030 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 750726 T2990 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40596",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40596_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 750728 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 750728 T2990 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51738",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51738_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 750731 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 750732 T2990 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:41285",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41285_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 750734 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 750836 T3049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750836 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750836 T2994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750836 T2989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750836 T3007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 750836 T3035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 751723 T2984 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 751723 T3016 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 751723 T3042 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 751724 T2984 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/solrj_collection_shard1_replica1
[junit4] 2> 751724 T3016 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2
[junit4] 2> 751724 T3042 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/solrj_collection_shard2_replica1
[junit4] 2> 751724 T3030 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 751724 T2984 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 751724 T3042 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 751725 T2984 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 751724 T3016 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 751726 T2984 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 751725 T3030 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/solrj_collection_shard2_replica2
[junit4] 2> 751727 T3030 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 751729 T3042 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 751730 T3042 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 751730 T2984 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 751729 T3016 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 751731 T3016 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 751729 T3030 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 751731 T3030 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 751730 T3042 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 751730 T2984 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/solrj_collection_shard1_replica1/'
[junit4] 2> 751732 T3042 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/solrj_collection_shard2_replica1/'
[junit4] 2> 751731 T3016 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 751733 T3016 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2/'
[junit4] 2> 751736 T3030 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 751736 T3030 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/solrj_collection_shard2_replica2/'
[junit4] 2> 751765 T2984 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 751765 T3030 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 751766 T3042 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 751827 T2984 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 751827 T3016 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 751828 T2984 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 751829 T3030 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 751830 T3042 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 751830 T3030 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 751831 T3042 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 751835 T2984 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 751839 T3042 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 751841 T3030 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 751844 T3016 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 751846 T3016 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 751866 T3016 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 752051 T3042 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 752051 T3042 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 752052 T3042 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 752052 T2984 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 752053 T2984 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 752053 T2984 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 752058 T2984 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 752058 T3042 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 752060 T2984 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 752061 T3042 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 752072 T3042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 752076 T3042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 752078 T2984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 752079 T3042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 752080 T3042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 752080 T3042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 752081 T3042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 752082 T3042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 752082 T3042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 752082 T2984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 752083 T3042 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 752084 T3042 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/solrj_collection_shard2_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/solrj_collection_shard2_replica1/data/
[junit4] 2> 752084 T3042 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49e4ed
[junit4] 2> 752085 T3042 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/solrj_collection_shard2_replica1/data
[junit4] 2> 752086 T2984 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 752086 T3042 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 752086 T3042 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 752087 T2984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 752087 T2984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 752087 T3042 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391727580164/solrj_collection_shard2_replica1/data/index
[junit4] 2> 752088 T3030 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 752088 T3042 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7605763910963864]
[junit4] 2> 752088 T2984 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 752088 T3030 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 752089 T3042 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1703e5d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1673d6e),segFN=segments_1,generation=1}
[junit4] 2> 752090 T3030 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 752090 T3042 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 752090 T2984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 752091 T2984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 752092 T2984 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 752092 T2984 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/solrj_collection_shard1_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/solrj_collection_shard1_replica1/data/
[junit4] 2> 752092 T2984 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49e4ed
[junit4] 2> 752093 T2984 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/solrj_collection_shard1_replica1/data
[junit4] 2> 752094 T3042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 752094 T2984 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 752094 T3042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 752095 T2984 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 752095 T3042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 752096 T2984 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391727576432/solrj_collection_shard1_replica1/data/index
[junit4] 2> 752095 T3030 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 752096 T2984 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7605763910963864]
[junit4] 2> 752096 T3042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 752097 T2984 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3baa52 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4b1e36),segFN=segments_1,generation=1}
[junit4] 2> 752098 T2984 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 752097 T3042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 752098 T3030 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 752098 T3042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 752099 T3042 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 752100 T3042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 752100 T3042 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 752101 T3042 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 752101 T3042 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 752102 T3042 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 752102 T3042 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 752101 T2984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 752103 T3042 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 752103 T2984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 752103 T3042 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 752104 T3042 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 752104 T2984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 752105 T2984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 752105 T2984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 752106 T2984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 752106 T2984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 752106 T2984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 752107 T2984 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 752107 T3042 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 752107 T2984 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 752109 T2984 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 752109 T2984 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 752110 T2984 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 752110 T2984 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 752111 T2984 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 752111 T2984 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 752112 T2984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 752109 T3042 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 752110 T3030 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 752113 T3042 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 752115 T2984 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 752115 T2984 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 752116 T3042 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7258817374178872]
[junit4] 2> 752116 T3030 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 752116 T3042 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1703e5d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1673d6e),segFN=segments_1,generation=1}
[junit4] 2> 752117 T3042 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 752117 T3042 oass.SolrIndexSearcher.<init> Opening Searcher@1645030[solrj_collection_shard2_replica1] main
[junit4] 2> 752116 T2984 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7258817374178872]
[junit4] 2> 752119 T3030 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 752120 T3030 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 752120 T3030 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 752120 T3055 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@1645030[solrj_collection_shard2_replica1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 752120 T3030 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 752120 T3016 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 752121 T3016 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 752122 T3016 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 752122 T2984 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3baa52 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4b1e36),segFN=segments_1,generation=1}
[junit4] 2> 752123 T2984 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 752123 T3030 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 752123 T3030 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 752124 T3030 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 752124 T3030 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/solrj_collection_shard2_replica2/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/solrj_collection_shard2_replica2/data/
[junit4] 2> 752124 T3030 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49e4ed
[junit4] 2> 752122 T3042 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
[junit4] 2> 752125 T3030 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/solrj_collection_shard2_replica2/data
[junit4] 2> 752123 T2984 oass.SolrIndexSearcher.<init> Opening Searcher@15b9577[solrj_collection_shard1_replica1] main
[junit4] 2> 752126 T3016 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 752127 T3016 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 752125 T3030 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 752125 T3042 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica1 address:http://127.0.0.1:40596 collection:solrj_collection shard:shard2
[junit4] 2> 752129 T3030 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 752128 T3056 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica1] Registered new searcher Searcher@15b9577[solrj_collection_shard1_replica1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 752133 T2984 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica1
[junit4] 2> 752134 T2984 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica1 address:http://127.0.0.1:57059 collection:solrj_collection shard:shard1
[junit4] 2> 752134 T3030 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391727578988/solrj_collection_shard2_replica2/data/index
[junit4] 2> 752135 T3030 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7605763910963864]
[junit4] 2> 752135 T3016 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 752135 T3042 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
[junit4] 2> 752136 T3030 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@d724d3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1e32e09),segFN=segments_1,generation=1}
[junit4] 2> 752136 T3030 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 752136 T2984 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard1/election
[junit4] 2> 752138 T3016 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 752140 T3030 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 752141 T3016 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 752141 T3030 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 752142 T2984 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 752142 T3030 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 752142 T3016 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 752143 T3016 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 752142 T3030 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 752143 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 752143 T3016 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 752143 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 752143 T3030 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 752144 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 752144 T3030 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 752145 T3016 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 752145 T3016 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 752145 T3030 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 752146 T3016 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 752146 T3030 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 752146 T2990 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 752146 T3016 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2/data/
[junit4] 2> 752146 T3030 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 752147 T3042 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 752147 T3016 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49e4ed
[junit4] 2> 752148 T3030 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 752149 T3030 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 752149 T3030 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 752149 T3016 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2/data
[junit4] 2> 752149 T3030 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 752149 T3016 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2/data/index/
[junit4] 2> 752150 T3030 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 752150 T3016 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 752150 T3030 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 752151 T3016 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2/data/index
[junit4] 2> 752151 T3030 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 752152 T2984 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=179999
[junit4] 2> 752151 T3016 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7605763910963864]
[junit4] 2> 752155 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 752153 T3042 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=180000
[junit4] 2> 752153 T3030 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 752161 T2989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 752161 T3016 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@125da lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@148111a),segFN=segments_1,generation=1}
[junit4] 2> 752162 T3016 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 752164 T3016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 752164 T3016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 752164 T3030 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 752165 T3016 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 752165 T3030 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 752165 T3016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 752166 T3016 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 752166 T3030 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7258817374178872]
[junit4] 2> 752166 T3016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 752167 T3030 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@d724d3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1e32e09),segFN=segments_1,generation=1}
[junit4] 2> 752167 T3030 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 752167 T3016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 752167 T3030 oass.SolrIndexSearcher.<init> Opening Searcher@1e21e44[solrj_collection_shard2_replica2] main
[junit4] 2> 752168 T3016 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 752173 T3016 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 752171 T3030 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica2
[junit4] 2> 752174 T3016 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 752170 T3059 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica2] Registered new searcher Searcher@1e21e44[solrj_collection_shard2_replica2] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 752174 T3030 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica2 address:http://127.0.0.1:41285 collection:solrj_collection shard:shard2
[junit4] 2> 752174 T3016 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 752175 T3016 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 752176 T3016 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 752176 T3016 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 752177 T3016 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 752177 T3016 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 752179 T3016 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 752180 T3016 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 752181 T3016 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 752181 T3016 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7258817374178872]
[junit4] 2> 752182 T3016 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@125da lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@148111a),segFN=segments_1,generation=1}
[junit4] 2> 752182 T3016 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 752182 T3016 oass.SolrIndexSearcher.<init> Opening Searcher@19585e5[solrj_collection_shard1_replica2] main
[junit4] 2> 752184 T3061 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica2] Registered new searcher Searcher@19585e5[solrj_collection_shard1_replica2] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 752185
[...truncated too long message...]
=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2/data/index;done=false>>]
[junit4] 2> 822656 T3021 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391727577825/solrj_collection_shard1_replica2/data/index
[junit4] 2> 822656 T3021 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leaders/shard1
[junit4] 2> 822656 T3021 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:203)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:203)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:414)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 822656 T3021 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/solrj_collection/leader_elect/shard1/election/91208258430435336-core_node3-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 822657 T3021 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 822657 T3021 oascc.ZkStateReader$4.process Updating aliases...
[junit4] 2> 822657 T3021 oascc.ZkStateReader$4.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 822657 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 822657 T3021 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 822657 T3021 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=ar_KW, timezone=America/Ensenada
[junit4] 2> NOTE: Linux 3.8.0-35-generic i386/Oracle Corporation 1.8.0 (32-bit)/cpus=8,threads=1,free=217533216,total=493879296
[junit4] 2> NOTE: All tests run in this JVM: [TestConfig, TestDocSet, TestSurroundQueryParser, ParsingFieldUpdateProcessorsTest, TestSuggestSpellingConverter, TestDocBasedVersionConstraints, TestBadConfig, AutoCommitTest, SolrInfoMBeanTest, TestSolrXmlPersistence, DistributedTermsComponentTest, TestLMJelinekMercerSimilarityFactory, RecoveryZkTest, BJQParserTest, DeleteShardTest, BlockDirectoryTest, AddBlockUpdateTest, UpdateParamsTest, TestDocumentBuilder, TestLFUCache, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, ZkControllerTest, TestDefaultSearchFieldResource, MBeansHandlerTest, ConnectionManagerTest, TestPHPSerializedResponseWriter, QueryParsingTest, CachingDirectoryFactoryTest, HdfsUnloadDistributedZkTest, SuggesterTest, ResponseLogComponentTest, QueryElevationComponentTest, HdfsCollectionsAPIDistributedZkTest, SystemInfoHandlerTest, TestExtendedDismaxParser, BinaryUpdateRequestHandlerTest, TestValueSourceCache, TestSchemaSimilarityResource, LoggingHandlerTest, FastVectorHighlighterTest, UpdateRequestProcessorFactoryTest, DocumentBuilderTest, TestFunctionQuery, UUIDFieldTest, StressHdfsTest, CSVRequestHandlerTest, HdfsDirectoryTest, ShardRoutingTest, ClusterStateUpdateTest, TestElisionMultitermQuery, TestGroupingSearch, SOLR749Test, TestPseudoReturnFields, SolrCoreTest, SolrTestCaseJ4Test, DateMathParserTest, TestDynamicFieldCollectionResource, TestQueryUtils, SchemaVersionSpecificBehaviorTest, ResourceLoaderTest, TestRandomMergePolicy, ZkCLITest, TermsComponentTest, TestSolrQueryParser, DOMUtilTest, ClusterStateTest, BasicFunctionalityTest, TestCoreContainer, TestLMDirichletSimilarityFactory, AssignTest, TestSolrXmlPersistor, CoreAdminHandlerTest, MoreLikeThisHandlerTest, AnalysisErrorHandlingTest, TestRemoteStreaming, FieldMutatingUpdateProcessorTest, AliasIntegrationTest, SyncSliceTest, SoftAutoCommitTest, TestAnalyzeInfixSuggestions, TestStandardQParsers, TestWriterPerf, CursorPagingTest, TermVectorComponentTest, DocValuesMissingTest, ShowFileRequestHandlerTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] Completed on J0 in 77.30s, 1 test, 1 error <<< FAILURES!
[...truncated 576 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 358 suites, 1554 tests, 1 error, 35 ignored (7 assumptions)
Total time: 53 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b128 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-fcs-b128) - Build #
9283 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9283/
Java: 32bit/jdk1.8.0-fcs-b128 -client -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Still found collection that should be gone
Stack Trace:
java.lang.AssertionError: Still found collection that should be gone
at __randomizedtesting.SeedInfo.seed([565C070A1E7FEA9A:D7BA891269208AA6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:402)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:210)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10481 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 828074 T4447 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /g_hho/kq
[junit4] 2> 828077 T4447 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1391752505286
[junit4] 2> 828078 T4447 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 828079 T4448 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 828179 T4447 oasc.ZkTestServer.run start zk server on port:58433
[junit4] 2> 828180 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 828413 T4454 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@860ddb name:ZooKeeperConnection Watcher:127.0.0.1:58433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 828414 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 828414 T4447 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 828419 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 828420 T4456 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ee94a name:ZooKeeperConnection Watcher:127.0.0.1:58433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 828420 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 828421 T4447 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 828424 T4447 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 828426 T4447 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 828427 T4447 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 828429 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 828430 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 828434 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 828435 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 828437 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 828438 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 828440 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 828440 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 828442 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 828442 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 828444 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 828444 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 828446 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 828446 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 828448 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 828448 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 828450 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 828451 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 828453 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 828453 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 828455 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 828455 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using old style solr.xml
[junit4] 2> 828458 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 828459 T4458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e7a07e name:ZooKeeperConnection Watcher:127.0.0.1:58433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 828459 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 828459 T4447 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 828462 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 828462 T4460 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ec95c name:ZooKeeperConnection Watcher:127.0.0.1:58433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 828463 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 828463 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 828464 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 828467 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 828467 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 828470 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 828471 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 828473 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 828474 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 828476 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 828476 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 828479 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 828480 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 828483 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 828484 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 828486 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 828487 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 828489 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 828490 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 828492 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 828492 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 828495 T4447 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 828495 T4447 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 828574 T4447 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 828578 T4447 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41932
[junit4] 2> 828579 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 828579 T4447 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 828580 T4447 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391752505706
[junit4] 2> 828580 T4447 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391752505706/'
[junit4] 2> 828598 T4447 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391752505706/solr.xml
[junit4] 2> 828607 T4447 oasc.CoreContainer.<init> New CoreContainer 1471586
[junit4] 2> 828607 T4447 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1391752505706/]
[junit4] 2> 828608 T4447 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 828608 T4447 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 828609 T4447 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 828609 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 828609 T4447 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 828609 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 828610 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 828610 T4447 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 828610 T4447 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 828612 T4447 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 828613 T4447 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 828613 T4447 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 828613 T4447 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58433/solr
[junit4] 2> 828614 T4447 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 828614 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 828617 T4471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ad1e9 name:ZooKeeperConnection Watcher:127.0.0.1:58433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 828617 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 828625 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 828626 T4473 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f76cbc name:ZooKeeperConnection Watcher:127.0.0.1:58433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 828626 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 828628 T4447 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 828631 T4447 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 828635 T4447 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 828636 T4447 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41932_g_hho%2Fkq
[junit4] 2> 828638 T4447 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41932_g_hho%2Fkq
[junit4] 2> 828640 T4447 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 828642 T4447 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 828645 T4447 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:41932_g_hho%2Fkq
[junit4] 2> 828646 T4447 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 828648 T4447 oasc.Overseer.start Overseer (id=91209892186554373-127.0.0.1:41932_g_hho%2Fkq-n_0000000000) starting
[junit4] 2> 828651 T4447 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 828655 T4475 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 828656 T4447 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 828657 T4475 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 828659 T4447 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 828661 T4447 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 828664 T4474 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 828665 T4447 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 828666 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 828667 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 828669 T4478 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a1d7ef name:ZooKeeperConnection Watcher:127.0.0.1:58433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 828669 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 828670 T4447 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 828672 T4447 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 828794 T4447 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 828794 T4447 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 828796 T4447 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58008
[junit4] 2> 828797 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 828797 T4447 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 828797 T4447 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881
[junit4] 2> 828798 T4447 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/'
[junit4] 2> 828820 T4447 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solr.xml
[junit4] 2> 828828 T4447 oasc.CoreContainer.<init> New CoreContainer 23634446
[junit4] 2> 828829 T4447 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/]
[junit4] 2> 828829 T4447 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 828829 T4447 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 828830 T4447 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 828830 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 828830 T4447 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 828831 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 828831 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 828831 T4447 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 828832 T4447 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 828834 T4447 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 828834 T4447 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 828834 T4447 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 828835 T4447 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58433/solr
[junit4] 2> 828835 T4447 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 828836 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 828837 T4489 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c33738 name:ZooKeeperConnection Watcher:127.0.0.1:58433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 828837 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 828839 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 828840 T4491 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e1623 name:ZooKeeperConnection Watcher:127.0.0.1:58433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 828840 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 828844 T4447 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 829847 T4447 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58008_g_hho%2Fkq
[junit4] 2> 829848 T4447 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58008_g_hho%2Fkq
[junit4] 2> 829851 T4478 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 829851 T4473 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 829851 T4491 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 829855 T4447 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 829856 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 829944 T4447 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 829945 T4447 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 829947 T4447 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58924
[junit4] 2> 829947 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 829947 T4447 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 829948 T4447 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064
[junit4] 2> 829948 T4447 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/'
[junit4] 2> 829968 T4447 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solr.xml
[junit4] 2> 829983 T4447 oasc.CoreContainer.<init> New CoreContainer 8417746
[junit4] 2> 829984 T4447 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/]
[junit4] 2> 829985 T4447 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 829985 T4447 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 829985 T4447 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 829985 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 829986 T4447 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 829986 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 829986 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 829987 T4447 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 829987 T4447 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 829989 T4447 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 829989 T4447 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 829990 T4447 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 829990 T4447 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58433/solr
[junit4] 2> 829991 T4447 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 829992 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 829993 T4503 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b67ff4 name:ZooKeeperConnection Watcher:127.0.0.1:58433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 829993 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 829997 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 829999 T4505 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ebd820 name:ZooKeeperConnection Watcher:127.0.0.1:58433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 830000 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 830003 T4447 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 831006 T4447 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58924_g_hho%2Fkq
[junit4] 2> 831008 T4447 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58924_g_hho%2Fkq
[junit4] 2> 831010 T4491 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 831010 T4505 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 831010 T4478 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 831010 T4473 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 831014 T4447 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 831015 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 831092 T4447 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 831093 T4447 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 831095 T4447 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57348
[junit4] 2> 831095 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 831096 T4447 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 831096 T4447 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223
[junit4] 2> 831096 T4447 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/'
[junit4] 2> 831122 T4447 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solr.xml
[junit4] 2> 831133 T4447 oasc.CoreContainer.<init> New CoreContainer 30448465
[junit4] 2> 831133 T4447 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/]
[junit4] 2> 831134 T4447 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 831134 T4447 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 831135 T4447 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 831135 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 831135 T4447 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 831135 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 831136 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 831136 T4447 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 831136 T4447 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 831139 T4447 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 831139 T4447 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 831140 T4447 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 831140 T4447 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58433/solr
[junit4] 2> 831141 T4447 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 831142 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 831143 T4517 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b242f7 name:ZooKeeperConnection Watcher:127.0.0.1:58433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 831143 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 831145 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 831147 T4519 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1471fa7 name:ZooKeeperConnection Watcher:127.0.0.1:58433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 831147 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 831151 T4447 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 832154 T4447 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57348_g_hho%2Fkq
[junit4] 2> 832157 T4447 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57348_g_hho%2Fkq
[junit4] 2> 832161 T4491 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 832161 T4473 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 832161 T4519 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 832161 T4478 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 832161 T4505 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 832165 T4447 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 832165 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 832242 T4447 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 832243 T4447 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 832245 T4447 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44115
[junit4] 2> 832245 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 832246 T4447 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 832246 T4447 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374
[junit4] 2> 832247 T4447 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/'
[junit4] 2> 832262 T4447 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solr.xml
[junit4] 2> 832270 T4447 oasc.CoreContainer.<init> New CoreContainer 20476817
[junit4] 2> 832270 T4447 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/]
[junit4] 2> 832271 T4447 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 832271 T4447 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 832272 T4447 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 832272 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 832272 T4447 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 832273 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 832273 T4447 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 832273 T4447 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 832273 T4447 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 832275 T4447 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 832276 T4447 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 832276 T4447 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 832276 T4447 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58433/solr
[junit4] 2> 832277 T4447 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 832277 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 832279 T4531 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@171a6cd name:ZooKeeperConnection Watcher:127.0.0.1:58433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 832279 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 832281 T4447 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 832282 T4533 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@81018d name:ZooKeeperConnection Watcher:127.0.0.1:58433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 832282 T4447 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 832285 T4447 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 833288 T4447 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44115_g_hho%2Fkq
[junit4] 2> 833289 T4447 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44115_g_hho%2Fkq
[junit4] 2> 833292 T4519 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 833292 T4478 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 833292 T4473 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 833293 T4533 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 833293 T4491 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 833292 T4505 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 833296 T4447 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 833296 T4447 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 833301 T4485 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&router.name=compositeId&action=CREATE&numShards=2&wt=javabin&version=2
[junit4] 2> 833303 T4473 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833304 T4475 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 833304 T4475 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 833305 T4475 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 833305 T4475 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 833308 T4473 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833310 T4474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 833310 T4474 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 833310 T4474 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 833312 T4473 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833313 T4533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833313 T4519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833313 T4478 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833313 T4505 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833313 T4473 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833313 T4491 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833409 T4475 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 833409 T4475 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:58008_g_hho%2Fkq
[junit4] 2> 833409 T4475 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:44115_g_hho%2Fkq
[junit4] 2> 833411 T4475 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:58924_g_hho%2Fkq
[junit4] 2> 833411 T4475 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:57348_g_hho%2Fkq
[junit4] 2> 833414 T4487 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
[junit4] 2> 833415 T4515 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
[junit4] 2> 833414 T4529 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
[junit4] 2> 833415 T4501 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
[junit4] 2> 833419 T4473 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833419 T4515 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 833420 T4501 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 833419 T4529 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 833419 T4487 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 833421 T4474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 833422 T4474 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58008/g_hho/kq",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:58008_g_hho%2Fkq",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 833424 T4473 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833424 T4474 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:57348/g_hho/kq",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57348_g_hho%2Fkq",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 833427 T4473 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833428 T4474 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44115/g_hho/kq",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:44115_g_hho%2Fkq",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 833430 T4473 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833431 T4474 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58924/g_hho/kq",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:58924_g_hho%2Fkq",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 833433 T4473 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 833536 T4519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833536 T4473 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833536 T4505 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833536 T4478 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833536 T4533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 833536 T4491 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 834420 T4515 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 834420 T4501 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 834421 T4515 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solr.xml
[junit4] 2> 834421 T4529 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 834421 T4487 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 834421 T4501 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solr.xml
[junit4] 2> 834421 T4515 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solrj_collection_shard2_replica2
[junit4] 2> 834423 T4515 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 834422 T4501 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solrj_collection_shard2_replica1
[junit4] 2> 834422 T4487 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solr.xml
[junit4] 2> 834422 T4529 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solr.xml
[junit4] 2> 834424 T4487 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solrj_collection_shard1_replica1
[junit4] 2> 834423 T4515 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 834425 T4515 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 834423 T4501 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 834424 T4487 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 834424 T4529 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solrj_collection_shard1_replica2
[junit4] 2> 834426 T4529 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 834426 T4515 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 834426 T4501 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 834427 T4501 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 834426 T4487 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 834427 T4487 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 834427 T4529 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 834428 T4529 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 834427 T4515 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solrj_collection_shard2_replica2/'
[junit4] 2> 834429 T4501 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 834429 T4501 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solrj_collection_shard2_replica1/'
[junit4] 2> 834430 T4487 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 834431 T4487 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solrj_collection_shard1_replica1/'
[junit4] 2> 834431 T4529 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 834432 T4529 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solrj_collection_shard1_replica2/'
[junit4] 2> 834463 T4515 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 834469 T4487 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 834490 T4515 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 834492 T4529 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 834493 T4515 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 834495 T4487 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 834495 T4501 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 834497 T4487 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 834518 T4515 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 834518 T4529 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 834520 T4529 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 834522 T4487 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 834522 T4501 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 834524 T4501 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 834533 T4529 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 834535 T4501 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 834770 T4515 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 834771 T4515 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 834772 T4515 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 834775 T4501 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 834775 T4501 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 834776 T4501 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 834777 T4515 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 834779 T4515 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 834783 T4501 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 834785 T4501 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 834789 T4487 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 834790 T4487 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 834791 T4487 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 834797 T4487 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 834798 T4515 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 834800 T4487 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 834803 T4529 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 834804 T4529 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 834804 T4501 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 834804 T4529 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 834807 T4515 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 834808 T4501 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 834810 T4529 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 834811 T4501 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 834810 T4515 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 834812 T4501 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 834812 T4501 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 834813 T4501 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 834813 T4515 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 834813 T4529 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 834814 T4501 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 834814 T4501 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 834813 T4515 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 834815 T4501 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 834815 T4515 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 834816 T4487 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 834815 T4501 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solrj_collection_shard2_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solrj_collection_shard2_replica1/data/
[junit4] 2> 834817 T4501 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f102ee
[junit4] 2> 834817 T4515 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 834818 T4515 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 834818 T4515 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 834818 T4501 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solrj_collection_shard2_replica1/data
[junit4] 2> 834818 T4515 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solrj_collection_shard2_replica2/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solrj_collection_shard2_replica2/data/
[junit4] 2> 834819 T4515 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f102ee
[junit4] 2> 834819 T4501 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 834819 T4487 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 834820 T4515 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solrj_collection_shard2_replica2/data
[junit4] 2> 834821 T4515 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 834821 T4515 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 834820 T4501 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 834822 T4515 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1391752508223/solrj_collection_shard2_replica2/data/index
[junit4] 2> 834831 T4515 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=9.40625, floorSegmentMB=1.478515625, forceMergeDeletesPctAllowed=10.950010391238859, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 834832 T4487 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 834831 T4501 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1391752507064/solrj_collection_shard2_replica1/data/index
[junit4] 2> 834832 T4515 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76e4ec lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12109f6),segFN=segments_1,generation=1}
[junit4] 2> 834833 T4515 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 834833 T4501 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=9.40625, floorSegmentMB=1.478515625, forceMergeDeletesPctAllowed=10.950010391238859, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 834834 T4487 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 834834 T4487 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 834835 T4501 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@10f7aae lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1563384),segFN=segments_1,generation=1}
[junit4] 2> 834836 T4501 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 834835 T4487 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 834836 T4529 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 834837 T4515 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 834838 T4487 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 834838 T4487 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 834838 T4515 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 834839 T4487 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 834839 T4515 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 834839 T4487 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solrj_collection_shard1_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solrj_collection_shard1_replica1/data/
[junit4] 2> 834840 T4529 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 834840 T4515 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 834840 T4501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 834840 T4487 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f102ee
[junit4] 2> 834841 T4501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 834842 T4501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 834842 T4501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 834841 T4515 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 834842 T4501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 834842 T4487 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solrj_collection_shard1_replica1/data
[junit4] 2> 834844 T4487 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 834843 T4501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 834843 T4529 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 834843 T4515 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 834844 T4501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 834845 T4515 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 834844 T4487 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 834846 T4515 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 834846 T4529 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 834847 T4529 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 834845 T4501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 834847 T4529 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 834847 T4515 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 834846 T4487 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1391752505881/solrj_collection_shard1_replica1/data/index
[junit4] 2> 834848 T4501 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 834849 T4487 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=9.40625, floorSegmentMB=1.478515625, forceMergeDeletesPctAllowed=10.950010391238859, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 834849 T4501 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 834849 T4515 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 834849 T4529 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 834852 T4529 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 834850 T4501 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 834853 T4501 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 834850 T4487 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@d9bcb8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ff6388),segFN=segments_1,generation=1}
[junit4] 2> 834854 T4487 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 834854 T4501 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 834853 T4529 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 834853 T4515 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 834855 T4515 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 834855 T4529 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solrj_collection_shard1_replica2/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solrj_collection_shard1_replica2/data/
[junit4] 2> 834855 T4501 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 834856 T4529 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f102ee
[junit4] 2> 834856 T4515 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 834857 T4501 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 834857 T4529 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solrj_collection_shard1_replica2/data
[junit4] 2> 834858 T4501 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 834858 T4529 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solrj_collection_shard1_replica2/data/index/
[junit4] 2> 834858 T4515 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 834858 T4487 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 834859 T4515 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 834858 T4529 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 834860 T4515 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 834860 T4501 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 834859 T4487 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 834860 T4529 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/solrj_collection_shard1_replica2/data/index
[junit4] 2> 834861 T4487 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 834861 T4515 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 834862 T4487 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 834862 T4529 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=9.40625, floorSegmentMB=1.478515625, forceMergeDeletesPctAllowed=10.950010391238859, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 834862 T4487 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 834862 T4501 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 834863 T4515 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 834863 T4529 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1c039fd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@129a3b3),segFN=segments_1,generation=1}
[junit4] 2> 834864 T4529 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 834863 T4487 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 834864 T4515 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 834865 T4487 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 834864 T4501 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 834866 T4487 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 834866 T4487 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 834866 T4515 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 834867 T4501 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 834868 T4515 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76e4ec lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12109f6),segFN=segments_1,generation=1}
[junit4] 2> 834868 T4515 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 834867 T4487 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 834869 T4515 oass.SolrIndexSearcher.<init> Opening Searcher@1097a59[solrj_collection_shard2_replica2] main
[junit4] 2> 834868 T4529 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 834868 T4501 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@10f7aae lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1563384),segFN=segments_1,generation=1}
[junit4] 2> 834870 T4501 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 834870 T4529 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 834869 T4487 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 834871 T4487 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 834871 T4529 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 834871 T4501 oass.SolrIndexSearcher.<init> Opening Searcher@c7d664[solrj_collection_shard2_replica1] main
[junit4] 2> 834872 T4529 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 834872 T4487 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 834873 T4529 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 834873 T4540 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica2] Registered new searcher Searcher@1097a59[solrj_collection_shard2_replica2] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 834874 T4529 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 834874 T4487 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 834875 T4529 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 834875 T4515 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica2
[junit4] 2> 834875 T4487 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 834875 T4515 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica2 address:http://127.0.0.1:57348/g_hho/kq collection:solrj_collection shard:shard2
[junit4] 2> 834875 T4529 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 834877 T4529 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 834876 T4487 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 834876 T4539 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@c7d664[solrj_collection_shard2_replica1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 834877 T4529 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 834877 T4515 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
[junit4] 2> 834878 T4487 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 834878 T4529 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 834879 T4529 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 834880 T4529 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 834880 T4501 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
[junit4] 2> 834880 T4501 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica1 address:http://127.0.0.1:58924/g_hho/kq collection:solrj_collection shard:shard2
[junit4] 2> 834881 T4487 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 834881 T4529 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 834881 T4487 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 834882 T4529 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 834882 T4501 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
[junit4] 2> 834883 T4487 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 834883 T4529 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 834884 T4487 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@d9bcb8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ff6388),segFN=segments_1,generation=1}
[junit4] 2> 834884 T4487 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 834885 T4487 oass.SolrIndexSearcher.<init> Opening Searcher@110920b[solrj_collection_shard1_replica1] main
[junit4] 2> 834885 T4529 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 834887 T4529 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 8
[...truncated too long message...]
[junit4] 2> 898249 T4533 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/acollectionafterbaddelete_shard1_replica1/data/index [CachedDir<<refCount=0;path=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/acollectionafterbaddelete_shard1_replica1/data/index;done=false>>]
[junit4] 2> 898249 T4533 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1391752509374/acollectionafterbaddelete_shard1_replica1/data/index
[junit4] 2> 898250 T4533 oascc.SolrZkClient.makePath makePath: /collections/acollectionafterbaddelete/leaders/shard1
[junit4] 2> 898250 T4533 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:203)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:203)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:414)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 898251 T4533 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/acollectionafterbaddelete/leader_elect/shard1/election/91209892186554382-core_node1-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 898251 T4533 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 898252 T4533 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=DefaultSimilarity, locale=ar_OM, timezone=Europe/Amsterdam
[junit4] 2> NOTE: Linux 3.8.0-35-generic i386/Oracle Corporation 1.8.0 (32-bit)/cpus=8,threads=1,free=68002944,total=212582400
[junit4] 2> NOTE: All tests run in this JVM: [TestRandomDVFaceting, TestValueSourceCache, TestSolrXmlPersistence, TestCursorMarkWithoutUniqueKey, HdfsLockFactoryTest, BadComponentTest, TestLMJelinekMercerSimilarityFactory, SliceStateTest, TestWriterPerf, PrimitiveFieldTypeTest, StressHdfsTest, TestCharFilters, ShardRoutingTest, TestSolrQueryParserDefaultOperatorResource, ResourceLoaderTest, MBeansHandlerTest, TestPostingsSolrHighlighter, ExternalFileFieldSortTest, AssignTest, CacheHeaderTest, ScriptEngineTest, TestSolrIndexConfig, TestCollationFieldDocValues, TestQueryUtils, TestLFUCache, TestFaceting, CursorPagingTest, DocValuesTest, UUIDFieldTest, StatelessScriptUpdateProcessorFactoryTest, TestPseudoReturnFields, SolrCoreTest, UnloadDistributedZkTest, PeerSyncTest, TestReplicationHandler, DistributedQueryElevationComponentTest, FileBasedSpellCheckerTest, SOLR749Test, TestSystemIdResolver, TestCoreContainer, JsonLoaderTest, HdfsBasicDistributedZkTest, SolrInfoMBeanTest, OverseerTest, HdfsCollectionsAPIDistributedZkTest, TestDynamicFieldCollectionResource, HdfsDirectoryTest, RecoveryZkTest, RegexBoostProcessorTest, CustomCollectionTest, TestTrie, UpdateParamsTest, URLClassifyProcessorTest, TestMergePolicyConfig, TestDocBasedVersionConstraints, SolrTestCaseJ4Test, SearchHandlerTest, BJQParserTest, HdfsUnloadDistributedZkTest, BasicDistributedZkTest, TestPerFieldSimilarity, ResponseLogComponentTest, TestElisionMultitermQuery, CachingDirectoryFactoryTest, TestConfig, DistributedSuggestComponentTest, SpellPossibilityIteratorTest, DeleteReplicaTest, TestLMDirichletSimilarityFactory, SampleTest, CoreAdminHandlerTest, AliasIntegrationTest, TestSolrXMLSerializer, LukeRequestHandlerTest, SliceStateUpdateTest, SoftAutoCommitTest, TestRealTimeGet, DistributedTermsComponentTest, TestDistribDocBasedVersion, SchemaVersionSpecificBehaviorTest, FieldMutatingUpdateProcessorTest, TestInfoStreamLogging, HdfsBasicDistributedZk2Test, AnalysisErrorHandlingTest, LoggingHandlerTest, TestRandomMergePolicy, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4] Completed on J0 in 71.19s, 1 test, 1 failure <<< FAILURES!
[...truncated 592 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 358 suites, 1554 tests, 1 failure, 35 ignored (7 assumptions)
Total time: 50 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b128 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_51) - Build # 9282
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9282/
Java: 32bit/jdk1.7.0_51 -client -XX:+UseParallelGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([A43CD570947D8178]:0)
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([A43CD570947D8178]:0)
Build Log:
[...truncated 10926 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 24107 T86 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /asyr/nz
[junit4] 2> 24115 T86 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeySafeLeaderTest-1391733847070
[junit4] 2> 24117 T86 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 24119 T87 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 24219 T86 oasc.ZkTestServer.run start zk server on port:60845
[junit4] 2> 24262 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 24353 T93 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e089f0 name:ZooKeeperConnection Watcher:127.0.0.1:60845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 24354 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 24358 T86 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 24393 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 24394 T95 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19f03a7 name:ZooKeeperConnection Watcher:127.0.0.1:60845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 24395 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 24398 T86 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 24402 T86 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 24405 T86 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 24408 T86 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 24412 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 24412 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 24418 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 24418 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 24422 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 24422 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 24426 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 24426 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 24430 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 24430 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 24434 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 24434 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 24438 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 24438 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 24453 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 24453 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 24458 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 24458 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 24462 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 24462 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 24465 T86 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 24466 T86 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 24543 T86 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 24547 T86 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58909
[junit4] 2> 24548 T86 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 24548 T86 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 24548 T86 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391733847425
[junit4] 2> 24548 T86 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391733847425/'
[junit4] 2> 24560 T86 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391733847425/solr.xml
[junit4] 2> 24603 T86 oasc.CoreContainer.<init> New CoreContainer 45727
[junit4] 2> 24603 T86 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391733847425/]
[junit4] 2> 24604 T86 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 24604 T86 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 24605 T86 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 24605 T86 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 24605 T86 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 24606 T86 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 24606 T86 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 24606 T86 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 24606 T86 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 24609 T86 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 24610 T86 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 24610 T86 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 24610 T86 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60845/solr
[junit4] 2> 24618 T86 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 24619 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 24621 T106 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10f7432 name:ZooKeeperConnection Watcher:127.0.0.1:60845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 24622 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 24626 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 24627 T108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@149394f name:ZooKeeperConnection Watcher:127.0.0.1:60845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 24627 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 24632 T86 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 24638 T86 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 24645 T86 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 24648 T86 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58909_asyr%2Fnz
[junit4] 2> 24653 T86 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58909_asyr%2Fnz
[junit4] 2> 24657 T86 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 24660 T86 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 24669 T86 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:58909_asyr%2Fnz
[junit4] 2> 24670 T86 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 24673 T86 oasc.Overseer.start Overseer (id=91208669405380611-127.0.0.1:58909_asyr%2Fnz-n_0000000000) starting
[junit4] 2> 24682 T86 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 24693 T110 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 24694 T86 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 24697 T86 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 24697 T110 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 24699 T86 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 24705 T109 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 24711 T111 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 24712 T111 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 24715 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24716 T111 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 24718 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 24719 T109 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58909/asyr/nz",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:58909_asyr%2Fnz",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 24720 T109 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 24726 T109 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 24730 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24734 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 25716 T111 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 25716 T111 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391733847425/collection1
[junit4] 2> 25717 T111 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 25718 T111 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 25718 T111 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 25719 T111 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 25719 T111 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391733847425/collection1/'
[junit4] 2> 25720 T111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391733847425/collection1/lib/classes/' to classloader
[junit4] 2> 25720 T111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391733847425/collection1/lib/README' to classloader
[junit4] 2> 25761 T111 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 25803 T111 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 25805 T111 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 25813 T111 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 26168 T111 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 26171 T111 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 26173 T111 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26176 T111 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26202 T111 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 26208 T111 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391733847425/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/control/data/
[junit4] 2> 26209 T111 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e5fb6c
[junit4] 2> 26212 T111 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/control/data
[junit4] 2> 26212 T111 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/control/data/index/
[junit4] 2> 26212 T111 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 26213 T111 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/control/data/index
[junit4] 2> 26213 T111 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=83.0556640625, floorSegmentMB=1.298828125, forceMergeDeletesPctAllowed=8.816480387134632, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 26224 T111 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 26225 T111 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 26229 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 26238 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 26239 T111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 26239 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 26239 T111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 26239 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 26240 T111 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 26240 T111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 26240 T111 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 26242 T111 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 26243 T111 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 26243 T111 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 26244 T111 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 26244 T111 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 26245 T111 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 26245 T111 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 26248 T111 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 26250 T111 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 26251 T111 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 26252 T111 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=0.876953125, floorSegmentMB=0.5654296875, forceMergeDeletesPctAllowed=10.437626435082636, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 26252 T111 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 26253 T111 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 26253 T111 oass.SolrIndexSearcher.<init> Opening Searcher@2edf7a[collection1] main
[junit4] 2> 26259 T112 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2edf7a[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 26263 T111 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 26263 T86 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 26264 T86 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 26264 T115 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58909/asyr/nz collection:control_collection shard:shard1
[junit4] 2> 26270 T115 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 26277 T115 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 26279 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26280 T115 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 26280 T115 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 26286 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C14 name=collection1 org.apache.solr.core.SolrCore@196935e url=http://127.0.0.1:58909/asyr/nz/collection1 node=127.0.0.1:58909_asyr%2Fnz C14_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:58909/asyr/nz, core=collection1, node_name=127.0.0.1:58909_asyr%2Fnz}
[junit4] 2> 26287 T115 C14 P58909 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58909/asyr/nz/collection1/
[junit4] 2> 26287 T115 C14 P58909 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 26288 T115 C14 P58909 oasc.SyncStrategy.syncToMe http://127.0.0.1:58909/asyr/nz/collection1/ has no replicas
[junit4] 2> 26288 T115 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58909/asyr/nz/collection1/ shard1
[junit4] 2> 26288 T115 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 26290 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26291 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 26295 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26296 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 26297 T117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c1edc6 name:ZooKeeperConnection Watcher:127.0.0.1:60845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 26298 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 26298 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 26300 T86 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 26301 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26303 T86 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 26378 T86 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 26379 T86 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 26381 T86 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38497
[junit4] 2> 26381 T86 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 26381 T86 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 26382 T86 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391733849258
[junit4] 2> 26382 T86 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391733849258/'
[junit4] 2> 26394 T86 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391733849258/solr.xml
[junit4] 2> 26404 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 26404 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 26439 T86 oasc.CoreContainer.<init> New CoreContainer 20245200
[junit4] 2> 26439 T86 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391733849258/]
[junit4] 2> 26440 T86 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 26440 T86 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 26441 T86 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 26441 T86 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 26441 T86 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 26441 T86 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 26442 T86 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 26442 T86 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 26442 T86 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 26445 T86 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 26445 T86 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 26445 T86 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 26446 T86 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60845/solr
[junit4] 2> 26446 T115 oasc.ZkController.register We are http://127.0.0.1:58909/asyr/nz/collection1/ and leader is http://127.0.0.1:58909/asyr/nz/collection1/
[junit4] 2> 26446 T86 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 26446 T115 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58909/asyr/nz
[junit4] 2> 26447 T115 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 26447 T115 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 26447 T115 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 26447 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 26449 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26449 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26449 T128 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ac601c name:ZooKeeperConnection Watcher:127.0.0.1:60845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 26449 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26449 T115 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 26449 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 26451 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 26452 T109 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:58909/asyr/nz",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:58909_asyr%2Fnz",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 26452 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 26454 T130 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@131cd72 name:ZooKeeperConnection Watcher:127.0.0.1:60845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 26454 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 26455 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26458 T86 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 26557 T130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 26557 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 26557 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 27461 T86 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38497_asyr%2Fnz
[junit4] 2> 27462 T86 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38497_asyr%2Fnz
[junit4] 2> 27465 T117 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 27465 T130 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 27465 T108 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 27474 T131 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 27474 T131 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 27475 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 27475 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 27475 T131 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 27475 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 27477 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 27478 T109 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38497/asyr/nz",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38497_asyr%2Fnz",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 27478 T109 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 27479 T109 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 27485 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 27589 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 27589 T130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 27589 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 28476 T131 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 28476 T131 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391733849258/collection1
[junit4] 2> 28476 T131 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 28477 T131 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 28477 T131 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 28479 T131 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 28479 T131 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391733849258/collection1/'
[junit4] 2> 28479 T131 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391733849258/collection1/lib/classes/' to classloader
[junit4] 2> 28480 T131 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391733849258/collection1/lib/README' to classloader
[junit4] 2> 28524 T131 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 28567 T131 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 28568 T131 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 28576 T131 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 28929 T131 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 28931 T131 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 28933 T131 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 28937 T131 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 28962 T131 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 28963 T131 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391733849258/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty1/
[junit4] 2> 28963 T131 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e5fb6c
[junit4] 2> 28964 T131 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty1
[junit4] 2> 28964 T131 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty1/index/
[junit4] 2> 28965 T131 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 28965 T131 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty1/index
[junit4] 2> 28966 T131 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=83.0556640625, floorSegmentMB=1.298828125, forceMergeDeletesPctAllowed=8.816480387134632, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 28995 T131 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 28995 T131 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 29007 T131 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 29007 T131 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 29007 T131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 29008 T131 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 29008 T131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 29008 T131 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 29008 T131 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 29009 T131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 29009 T131 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 29010 T131 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 29011 T131 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 29011 T131 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 29011 T131 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 29012 T131 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 29013 T131 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 29014 T131 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 29016 T131 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 29018 T131 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 29019 T131 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 29020 T131 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=0.876953125, floorSegmentMB=0.5654296875, forceMergeDeletesPctAllowed=10.437626435082636, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 29021 T131 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 29021 T131 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 29021 T131 oass.SolrIndexSearcher.<init> Opening Searcher@14dd665[collection1] main
[junit4] 2> 29028 T132 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14dd665[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 29032 T131 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 29033 T86 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 29033 T86 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 29033 T135 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38497/asyr/nz collection:collection1 shard:shard1
[junit4] 2> 29035 T135 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 29043 T135 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 29046 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29046 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29046 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29046 T135 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 29046 T135 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C15 name=collection1 org.apache.solr.core.SolrCore@5caedc url=http://127.0.0.1:38497/asyr/nz/collection1 node=127.0.0.1:38497_asyr%2Fnz C15_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:38497/asyr/nz, core=collection1, node_name=127.0.0.1:38497_asyr%2Fnz}
[junit4] 2> 29047 T135 C15 P38497 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38497/asyr/nz/collection1/
[junit4] 2> 29047 T135 C15 P38497 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 29047 T135 C15 P38497 oasc.SyncStrategy.syncToMe http://127.0.0.1:38497/asyr/nz/collection1/ has no replicas
[junit4] 2> 29048 T135 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38497/asyr/nz/collection1/ shard1
[junit4] 2> 29048 T135 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 29048 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 29052 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29055 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29059 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29114 T86 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 29115 T86 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 29116 T86 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36207
[junit4] 2> 29117 T86 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 29117 T86 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 29117 T86 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391733851989
[junit4] 2> 29118 T86 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391733851989/'
[junit4] 2> 29129 T86 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391733851989/solr.xml
[junit4] 2> 29163 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 29163 T130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 29163 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 29178 T86 oasc.CoreContainer.<init> New CoreContainer 11924304
[junit4] 2> 29178 T86 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391733851989/]
[junit4] 2> 29179 T86 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 29180 T86 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 29180 T86 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 29180 T86 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 29180 T86 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 29181 T86 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 29181 T86 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 29181 T86 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 29181 T86 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 29184 T86 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 29184 T86 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 29185 T86 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 29185 T86 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60845/solr
[junit4] 2> 29185 T86 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 29186 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 29188 T146 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a34889 name:ZooKeeperConnection Watcher:127.0.0.1:60845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 29188 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 29191 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 29192 T148 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ad9085 name:ZooKeeperConnection Watcher:127.0.0.1:60845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 29192 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 29196 T86 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 29206 T135 oasc.ZkController.register We are http://127.0.0.1:38497/asyr/nz/collection1/ and leader is http://127.0.0.1:38497/asyr/nz/collection1/
[junit4] 2> 29206 T135 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38497/asyr/nz
[junit4] 2> 29206 T135 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 29206 T135 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 29206 T135 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 29208 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29208 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29209 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29209 T135 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 29210 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 29211 T109 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:38497/asyr/nz",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38497_asyr%2Fnz",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 29214 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 29317 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 29317 T148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 29317 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 29317 T130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 30199 T86 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36207_asyr%2Fnz
[junit4] 2> 30200 T86 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36207_asyr%2Fnz
[junit4] 2> 30203 T117 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 30203 T108 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 30204 T130 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 30205 T148 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 30214 T149 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 30215 T149 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 30217 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30217 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30217 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30217 T149 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 30219 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 30220 T109 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36207/asyr/nz",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36207_asyr%2Fnz",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 30220 T109 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 30220 T109 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 30224 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 30327 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30327 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30327 T130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 30327 T148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 31218 T149 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 31218 T149 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391733851989/collection1
[junit4] 2> 31219 T149 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 31220 T149 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 31221 T149 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 31223 T149 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 31223 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391733851989/collection1/'
[junit4] 2> 31224 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391733851989/collection1/lib/classes/' to classloader
[junit4] 2> 31224 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391733851989/collection1/lib/README' to classloader
[junit4] 2> 31274 T149 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 31324 T149 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 31325 T149 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 31335 T149 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 31767 T149 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 31770 T149 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 31773 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 31777 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 31811 T149 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 31811 T149 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391733851989/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty2/
[junit4] 2> 31811 T149 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e5fb6c
[junit4] 2> 31812 T149 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty2
[junit4] 2> 31812 T149 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty2/index/
[junit4] 2> 31813 T149 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 31813 T149 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty2/index
[junit4] 2> 31814 T149 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=83.0556640625, floorSegmentMB=1.298828125, forceMergeDeletesPctAllowed=8.816480387134632, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 31817 T149 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 31817 T149 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 31824 T149 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 31824 T149 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 31825 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 31825 T149 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 31826 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 31826 T149 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 31826 T149 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 31827 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 31827 T149 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 31828 T149 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 31829 T149 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 31829 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 31830 T149 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 31831 T149 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 31832 T149 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 31833 T149 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 31837 T149 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 31840 T149 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 31840 T149 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 31841 T149 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=0.876953125, floorSegmentMB=0.5654296875, forceMergeDeletesPctAllowed=10.437626435082636, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 31842 T149 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 31842 T149 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 31842 T149 oass.SolrIndexSearcher.<init> Opening Searcher@1c7e1ba[collection1] main
[junit4] 2> 31850 T150 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c7e1ba[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 31856 T149 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 31858 T86 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 31858 T86 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 31858 T153 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36207/asyr/nz collection:collection1 shard:shard2
[junit4] 2> 31860 T153 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 31868 T153 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 31870 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 31870 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 31870 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 31870 T153 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 31871 T153 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@e919dd url=http://127.0.0.1:36207/asyr/nz/collection1 node=127.0.0.1:36207_asyr%2Fnz C16_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:36207/asyr/nz, core=collection1, node_name=127.0.0.1:36207_asyr%2Fnz}
[junit4] 2> 31871 T153 C16 P36207 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36207/asyr/nz/collection1/
[junit4] 2> 31871 T153 C16 P36207 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 31871 T153 C16 P36207 oasc.SyncStrategy.syncToMe http://127.0.0.1:36207/asyr/nz/collection1/ has no replicas
[junit4] 2> 31872 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 31872 T153 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36207/asyr/nz/collection1/ shard2
[junit4] 2> 31873 T153 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 31878 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 31880 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 31880 T130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 31880 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 31880 T148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 31885 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 31889 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 31948 T86 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 31949 T86 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 31951 T86 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34579
[junit4] 2> 31951 T86 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 31952 T86 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 31952 T86 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391733854814
[junit4] 2> 31952 T86 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391733854814/'
[junit4] 2> 31966 T86 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391733854814/solr.xml
[junit4] 2> 31991 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 31992 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 31992 T130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 31991 T148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 32021 T86 oasc.CoreContainer.<init> New CoreContainer 4159914
[junit4] 2> 32022 T86 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391733854814/]
[junit4] 2> 32023 T86 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 32024 T86 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 32024 T86 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 32024 T86 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 32025 T86 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 32025 T86 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 32025 T86 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 32026 T86 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 32026 T86 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 32029 T86 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 32030 T86 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 32030 T86 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 32031 T86 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60845/solr
[junit4] 2> 32031 T86 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 32032 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 32034 T164 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ad952 name:ZooKeeperConnection Watcher:127.0.0.1:60845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32034 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 32035 T153 oasc.ZkController.register We are http://127.0.0.1:36207/asyr/nz/collection1/ and leader is http://127.0.0.1:36207/asyr/nz/collection1/
[junit4] 2> 32035 T153 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36207/asyr/nz
[junit4] 2> 32036 T153 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 32036 T153 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 32036 T153 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 32038 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 32038 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 32038 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 32039 T153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 32039 T86 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 32042 T166 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@463f1a name:ZooKeeperConnection Watcher:127.0.0.1:60845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32042 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 32042 T86 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 32043 T109 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:36207/asyr/nz",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36207_asyr%2Fnz",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 32047 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 32049 T86 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 32152 T130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 32152 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 32152 T148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 32152 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 32152 T166 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 33053 T86 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34579_asyr%2Fnz
[junit4] 2> 33056 T86 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34579_asyr%2Fnz
[junit4] 2> 33061 T130 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 33062 T166 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 33062 T148 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 33062 T108 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 33062 T117 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 33078 T167 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 33079 T167 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 33081 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 33081 T167 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 33081 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 33082 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 33084 T109 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 33085 T109 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34579/asyr/nz",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34579_asyr%2Fnz",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 33086 T109 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 33086 T109 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 33090 T108 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 33195 T148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 33195 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 33195 T166 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 33195 T130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 33195 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 34082 T167 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 34082 T167 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391733854814/collection1
[junit4] 2> 34083 T167 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 34083 T167 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 34084 T167 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 34085 T167 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 34085 T167 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391733854814/collection1/'
[junit4] 2> 34086 T167 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391733854814/collection1/lib/classes/' to classloader
[junit4] 2> 34086 T167 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391733854814/collection1/lib/README' to classloader
[junit4] 2> 34143 T167 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 34193 T167 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 34195 T167 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 34204 T167 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 34607 T167 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 34610 T167 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 34612 T167 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 34617 T167 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 34664 T167 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 34665 T167 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391733854814/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty3/
[junit4] 2> 34666 T167 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e5fb6c
[junit4] 2> 34668 T167 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty3
[junit4] 2> 34668 T167 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty3/index/
[junit4] 2> 34669 T167 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 34670 T167 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty3/index
[junit4] 2> 34671 T167 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=83.0556640625, floorSegmentMB=1.298828125, forceMergeDeletesPctAllowed=8.816480387134632, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 34679 T167 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty3/index,segFN=segments_1,generation=1}
[junit4] 2> 34679 T167 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 34687 T167 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 34688 T167 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 34688 T167 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 34689 T167 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 34689 T167 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 34690 T167 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 34691 T167 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 34691 T167 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 34691 T167 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 34692 T167 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 34694 T167 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 34695 T167 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 34695 T167 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 34696 T167 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 34697 T167 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 34698 T167 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 34701 T167 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 34704 T167 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 34704 T167 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 34706 T167 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=0.876953125, floorSegmentMB=0.5654296875, forceMergeDeletesPctAllowed=10.437626435082636, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 34707 T167 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391733847070/jetty3/index,segFN=segments_1,generation=1}
[junit4] 2> 34707 T167 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 34707 T167 oass.SolrIndexSearcher.<init> Opening Searcher@103e081[collection1] main
[junit4] 2> 34717 T168 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@103e081[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 34722 T167 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 34722 T86 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 34723 T86 oass.SolrDispatchFilte
[...truncated too long message...]
ctorManager$1.run(SelectorManager.java:290)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 56) Thread[id=168, name=searcherExecutor-125-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 57) Thread[id=780, name=qtp8167742-780 Selector0, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.nio.ch.IOUtil.drain(Native Method)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:90)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 58) Thread[id=639, name=Thread-182-SendThread(localhost.localdomain:60845), state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] 2> 59) Thread[id=775, name=coreZkRegister-360-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 60) Thread[id=725, name=qtp16425340-725 Acceptor1 SelectChannelConnector@127.0.0.1:50860, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at org.eclipse.jetty.server.nio.SelectChannelConnector.getConnection(SelectChannelConnector.java:160)
[junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:934)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 61) Thread[id=154, name=HashSessionScavenger-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> 62) Thread[id=782, name=qtp8167742-782 Acceptor0 SelectChannelConnector@127.0.0.1:40672, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at org.eclipse.jetty.server.nio.SelectChannelConnector.getConnection(SelectChannelConnector.java:160)
[junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:934)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 63) Thread[id=649, name=coreZkRegister-317-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 64) Thread[id=739, name=qtp8253092-739 Selector0, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Thread.isInterrupted(Native Method)
[junit4] 2> at java.lang.Thread.isInterrupted(Thread.java:999)
[junit4] 2> at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:215)
[junit4] 2> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:78)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> NOTE: test params are: codec=Lucene46: {rnd_b=PostingsFormat(name=Memory doPackFST= false), a_si=FST41, a_t=Lucene41(blocksize=128), id=PostingsFormat(name=Memory doPackFST= false), _version_=FST41}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=es_GT, timezone=America/Sitka
[junit4] 2> NOTE: Linux 3.8.0-35-generic i386/Oracle Corporation 1.7.0_51 (32-bit)/cpus=8,threads=78,free=64796688,total=211288064
[junit4] 2> NOTE: All tests run in this JVM: [TestIndexingPerformance, DirectUpdateHandlerTest, StatsComponentTest, DefaultValueUpdateProcessorTest, HardAutoCommitTest, OpenExchangeRatesOrgProviderTest, CoreContainerCoreInitFailuresTest, TestFieldResource, TestIBSimilarityFactory, SimplePostToolTest, TestQuerySenderListener, ChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=A43CD570947D8178 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_GT -Dtests.timezone=America/Sitka -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([A43CD570947D8178]:0)
[junit4] Completed on J1 in 7224.79s, 1 test, 2 errors <<< FAILURES!
[...truncated 242 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 358 suites, 1554 tests, 1 suite-level error, 1 error, 301 ignored (3 assumptions)
Total time: 146 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_51 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure