You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/01/04 16:05:16 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_60-ea-b02) -
Build # 8957 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/8957/
Java: 32bit/jdk1.7.0_60-ea-b02 -server -XX:+UseParallelGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([C8AF6A6DFFC1F139:4949E475889E9105]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.junit.Assert.assertFalse(Assert.java:79)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:390)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:203)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:849)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10238 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 648244 T3254 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_oao/
[junit4] 2> 648247 T3254 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1388847450191
[junit4] 2> 648247 T3254 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 648248 T3255 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 648348 T3254 oasc.ZkTestServer.run start zk server on port:37184
[junit4] 2> 648349 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 649920 T3258 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 1570ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 649922 T3262 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1429f38 name:ZooKeeperConnection Watcher:127.0.0.1:37184 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 649923 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 649923 T3254 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 649930 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 649932 T3265 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12e3a88 name:ZooKeeperConnection Watcher:127.0.0.1:37184/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 649933 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 649933 T3254 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 649936 T3254 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 649938 T3254 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 649939 T3254 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 649942 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 649942 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 649945 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 649946 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 649948 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 649948 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 649950 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 649950 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 649952 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 649953 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 649954 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 649955 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 649957 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 649957 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 649960 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 649960 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 649963 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 649963 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 649966 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 649966 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 649968 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 649968 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using new style solr.xml
[junit4] 2> 649972 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 649973 T3268 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@168ff6a name:ZooKeeperConnection Watcher:127.0.0.1:37184 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 649973 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 649973 T3254 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 649976 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 649977 T3271 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78a0cf name:ZooKeeperConnection Watcher:127.0.0.1:37184/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 649977 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 649977 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 649978 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 649981 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 649981 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 649984 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 649984 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 649987 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 649987 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 649990 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 649990 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 649993 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 649993 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 649995 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 649995 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 649997 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 649997 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 649999 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 649999 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 650001 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 650006 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 650009 T3254 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 650009 T3254 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 650071 T3254 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 650073 T3254 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:42567
[junit4] 2> 650074 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 650074 T3254 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 650074 T3254 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956
[junit4] 2> 650074 T3254 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/'
[junit4] 2> 650084 T3254 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/solr.xml
[junit4] 2> 650103 T3254 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 650104 T3254 oasc.CoreContainer.<init> New CoreContainer 2295970
[junit4] 2> 650104 T3254 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/]
[junit4] 2> 650105 T3254 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 650105 T3254 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 650105 T3254 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 650106 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 650106 T3254 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 650106 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 650106 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 650107 T3254 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 650107 T3254 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 650109 T3254 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 650109 T3254 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 650109 T3254 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 650110 T3254 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37184/solr
[junit4] 2> 650110 T3254 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 650111 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 650112 T3283 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29477a name:ZooKeeperConnection Watcher:127.0.0.1:37184 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 650112 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 650114 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 650115 T3286 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f6828 name:ZooKeeperConnection Watcher:127.0.0.1:37184/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 650115 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 650116 T3254 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 650119 T3254 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 650120 T3254 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 650121 T3254 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42567__oao
[junit4] 2> 650122 T3254 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42567__oao
[junit4] 2> 650124 T3254 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 650125 T3254 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 650127 T3254 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 650130 T3254 oasc.Overseer.start Overseer (id=91019506495848453-127.0.0.1:42567__oao-n_0000000000) starting
[junit4] 2> 650133 T3254 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 650136 T3288 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 650136 T3254 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 650138 T3254 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 650139 T3254 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 650141 T3287 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 650142 T3254 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956
[junit4] 2> 650143 T3254 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/conf/
[junit4] 2> 650163 T3254 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 650164 T3254 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 650164 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 650165 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 650166 T3292 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ac2326 name:ZooKeeperConnection Watcher:127.0.0.1:37184/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 650166 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 650167 T3254 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 650169 T3254 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 650229 T3254 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 650231 T3254 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35172
[junit4] 2> 650231 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 650231 T3254 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 650232 T3254 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113
[junit4] 2> 650232 T3254 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/'
[junit4] 2> 650241 T3254 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/solr.xml
[junit4] 2> 650260 T3254 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 650261 T3254 oasc.CoreContainer.<init> New CoreContainer 19209861
[junit4] 2> 650261 T3254 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/]
[junit4] 2> 650262 T3254 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 650262 T3254 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 650262 T3254 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 650262 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 650263 T3254 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 650263 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 650263 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 650263 T3254 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 650264 T3254 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 650266 T3254 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 650266 T3254 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 650266 T3254 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 650266 T3254 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37184/solr
[junit4] 2> 650267 T3254 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 650268 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 650269 T3304 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@80c1b6 name:ZooKeeperConnection Watcher:127.0.0.1:37184 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 650269 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 650271 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 650272 T3307 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1afad1c name:ZooKeeperConnection Watcher:127.0.0.1:37184/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 650272 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 650275 T3254 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 651278 T3254 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35172__oao
[junit4] 2> 651279 T3254 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35172__oao
[junit4] 2> 651281 T3286 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 651281 T3292 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 651281 T3307 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 651285 T3254 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113
[junit4] 2> 651286 T3254 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/conf/
[junit4] 2> 651314 T3254 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 651315 T3254 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 651315 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 651373 T3254 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 651375 T3254 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56037
[junit4] 2> 651375 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 651375 T3254 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 651376 T3254 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388847453259
[junit4] 2> 651376 T3254 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388847453259/'
[junit4] 2> 651385 T3254 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388847453259/solr.xml
[junit4] 2> 651404 T3254 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 651404 T3254 oasc.CoreContainer.<init> New CoreContainer 23839726
[junit4] 2> 651405 T3254 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388847453259/]
[junit4] 2> 651405 T3254 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 651406 T3254 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 651406 T3254 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 651406 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 651406 T3254 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 651407 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 651407 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 651407 T3254 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 651407 T3254 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 651409 T3254 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 651410 T3254 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 651410 T3254 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 651410 T3254 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37184/solr
[junit4] 2> 651410 T3254 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 651411 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 651413 T3320 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@173b986 name:ZooKeeperConnection Watcher:127.0.0.1:37184 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 651413 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 651415 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 651416 T3323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b16148 name:ZooKeeperConnection Watcher:127.0.0.1:37184/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 651416 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 651419 T3254 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 652421 T3254 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56037__oao
[junit4] 2> 652423 T3254 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56037__oao
[junit4] 2> 652426 T3307 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 652426 T3286 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 652426 T3292 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 652426 T3323 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 652430 T3254 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388847453259
[junit4] 2> 652431 T3254 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1388847453259/conf/
[junit4] 2> 652450 T3254 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 652451 T3254 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 652451 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 652508 T3254 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 652510 T3254 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37935
[junit4] 2> 652510 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 652511 T3254 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 652511 T3254 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395
[junit4] 2> 652511 T3254 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/'
[junit4] 2> 652520 T3254 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/solr.xml
[junit4] 2> 652540 T3254 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 652540 T3254 oasc.CoreContainer.<init> New CoreContainer 27229393
[junit4] 2> 652540 T3254 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/]
[junit4] 2> 652541 T3254 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 652541 T3254 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 652542 T3254 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 652542 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 652542 T3254 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 652542 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 652543 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 652543 T3254 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 652543 T3254 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 652545 T3254 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 652545 T3254 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 652546 T3254 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 652546 T3254 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37184/solr
[junit4] 2> 652546 T3254 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 652547 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 652548 T3336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49ea8e name:ZooKeeperConnection Watcher:127.0.0.1:37184 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652548 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 652550 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 652551 T3339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1294cb7 name:ZooKeeperConnection Watcher:127.0.0.1:37184/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652552 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 652557 T3254 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 653560 T3254 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37935__oao
[junit4] 2> 653562 T3254 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37935__oao
[junit4] 2> 653566 T3339 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 653566 T3286 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 653566 T3292 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 653566 T3307 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 653566 T3323 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 653573 T3254 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395
[junit4] 2> 653574 T3254 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/conf/
[junit4] 2> 653611 T3254 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 653611 T3254 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 653611 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 653669 T3254 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 653671 T3254 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55428
[junit4] 2> 653672 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 653672 T3254 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 653672 T3254 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556
[junit4] 2> 653673 T3254 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/'
[junit4] 2> 653690 T3254 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/solr.xml
[junit4] 2> 653711 T3254 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 653711 T3254 oasc.CoreContainer.<init> New CoreContainer 21067701
[junit4] 2> 653712 T3254 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/]
[junit4] 2> 653712 T3254 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 653713 T3254 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 653713 T3254 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 653713 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 653713 T3254 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 653714 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 653714 T3254 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 653714 T3254 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 653714 T3254 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 653716 T3254 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 653717 T3254 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 653717 T3254 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 653717 T3254 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37184/solr
[junit4] 2> 653718 T3254 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 653719 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 653720 T3352 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12a6533 name:ZooKeeperConnection Watcher:127.0.0.1:37184 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 653720 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 653723 T3254 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 653724 T3355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19653a name:ZooKeeperConnection Watcher:127.0.0.1:37184/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 653724 T3254 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 653730 T3254 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 654734 T3254 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55428__oao
[junit4] 2> 654736 T3254 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55428__oao
[junit4] 2> 654739 T3323 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 654739 T3339 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 654739 T3292 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 654739 T3355 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 654739 T3286 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 654739 T3307 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 654744 T3254 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556
[junit4] 2> 654745 T3254 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/conf/
[junit4] 2> 654772 T3254 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 654773 T3254 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 654773 T3254 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 654780 T3299 oasha.CollectionsHandler.handleCreateAction Creating Collection : router.field=myOwnField&replicationFactor=2&name=solrj_collection&action=CREATE&wt=javabin&numShards=2&collection.configName=conf1&router.name=compositeId&version=2
[junit4] 2> 654782 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 654783 T3288 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 654784 T3288 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 654784 T3288 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 654784 T3288 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 654790 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 654792 T3287 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 654793 T3287 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 654793 T3287 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 654795 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 654795 T3339 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 654795 T3355 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 654795 T3307 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 654795 T3292 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 654795 T3323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 654795 T3286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 654891 T3288 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 654891 T3288 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:42567__oao
[junit4] 2> 654891 T3288 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:37935__oao
[junit4] 2> 654893 T3288 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:55428__oao
[junit4] 2> 654894 T3288 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:35172__oao
[junit4] 2> 654895 T3279 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
[junit4] 2> 654896 T3331 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
[junit4] 2> 654897 T3347 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
[junit4] 2> 654897 T3300 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
[junit4] 2> 654898 T3279 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 654898 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 654898 T3331 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 654900 T3347 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 654900 T3300 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 654901 T3287 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 654902 T3287 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42567/_oao",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:42567__oao",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 654906 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 654908 T3287 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37935/_oao",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37935__oao",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 654913 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 654915 T3287 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55428/_oao",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55428__oao",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 654919 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 654920 T3287 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35172/_oao",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:35172__oao",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 654924 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 655027 T3292 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 655028 T3286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 655028 T3355 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 655028 T3339 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 655027 T3307 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 655027 T3323 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 655899 T3279 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 655900 T3331 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 655900 T3279 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/solrj_collection_shard1_replica1
[junit4] 2> 655900 T3279 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 655900 T3331 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/solrj_collection_shard1_replica2
[junit4] 2> 655900 T3347 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 655901 T3279 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 655901 T3279 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 655900 T3331 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 655901 T3347 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/solrj_collection_shard2_replica1
[junit4] 2> 655902 T3331 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 655902 T3331 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 655901 T3300 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 655902 T3279 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/solrj_collection_shard1_replica1/'
[junit4] 2> 655902 T3347 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 655903 T3300 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/solrj_collection_shard2_replica2
[junit4] 2> 655903 T3300 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 655903 T3331 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/solrj_collection_shard1_replica2/'
[junit4] 2> 655904 T3300 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 655904 T3300 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 655904 T3347 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 655905 T3347 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 655905 T3300 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/solrj_collection_shard2_replica2/'
[junit4] 2> 655906 T3347 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/solrj_collection_shard2_replica1/'
[junit4] 2> 655948 T3279 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 655953 T3347 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 655956 T3331 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 655963 T3300 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 655980 T3279 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 655982 T3279 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 655985 T3347 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 655986 T3347 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 655988 T3331 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 655989 T3331 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 655990 T3279 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 655992 T3300 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 655993 T3300 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 655995 T3347 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 655998 T3331 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 655998 T3300 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 656249 T3347 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 656254 T3347 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 656256 T3347 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 656279 T3331 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 656284 T3331 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 656285 T3347 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 656286 T3331 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 656288 T3300 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 656288 T3347 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 656292 T3347 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 656293 T3300 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 656293 T3347 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 656293 T3347 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 656294 T3347 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 656295 T3347 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 656295 T3347 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 656295 T3300 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 656295 T3347 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 656296 T3347 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/solrj_collection_shard2_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/solrj_collection_shard2_replica1/data/
[junit4] 2> 656296 T3347 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ff34
[junit4] 2> 656297 T3347 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/solrj_collection_shard2_replica1/data
[junit4] 2> 656297 T3331 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 656297 T3347 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 656298 T3347 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 656298 T3347 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1388847455556/solrj_collection_shard2_replica1/data/index
[junit4] 2> 656299 T3347 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=35.80078125, floorSegmentMB=0.29296875, forceMergeDeletesPctAllowed=17.287363853457354, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 656300 T3347 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@17e21b6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@132ea21),segFN=segments_1,generation=1}
[junit4] 2> 656300 T3347 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 656301 T3331 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 656304 T3347 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 656304 T3331 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 656304 T3300 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 656304 T3347 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 656304 T3279 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 656305 T3347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 656305 T3331 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 656306 T3331 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 656306 T3347 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 656306 T3331 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 656307 T3347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 656307 T3347 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 656307 T3300 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 656308 T3347 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 656308 T3331 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 656308 T3331 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 656308 T3347 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 656308 T3331 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 656309 T3347 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 656309 T3331 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/solrj_collection_shard1_replica2/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/solrj_collection_shard1_replica2/data/
[junit4] 2> 656309 T3347 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 656310 T3300 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 656310 T3347 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 656310 T3347 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 656309 T3331 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ff34
[junit4] 2> 656311 T3300 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 656311 T3300 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 656310 T3347 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 656311 T3279 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 656311 T3331 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/solrj_collection_shard1_replica2/data
[junit4] 2> 656311 T3300 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 656312 T3331 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/solrj_collection_shard1_replica2/data/index/
[junit4] 2> 656311 T3347 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 656312 T3331 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 656313 T3300 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 656313 T3300 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 656313 T3347 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 656314 T3300 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 656313 T3331 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/solrj_collection_shard1_replica2/data/index
[junit4] 2> 656314 T3279 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 656314 T3300 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/solrj_collection_shard2_replica2/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/solrj_collection_shard2_replica2/data/
[junit4] 2> 656314 T3347 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 656315 T3300 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ff34
[junit4] 2> 656314 T3331 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=35.80078125, floorSegmentMB=0.29296875, forceMergeDeletesPctAllowed=17.287363853457354, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 656315 T3347 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 656316 T3300 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/solrj_collection_shard2_replica2/data
[junit4] 2> 656316 T3331 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@14147fe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@72d757),segFN=segments_1,generation=1}
[junit4] 2> 656317 T3331 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 656316 T3300 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 656317 T3300 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 656318 T3300 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1388847452113/solrj_collection_shard2_replica2/data/index
[junit4] 2> 656318 T3300 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=35.80078125, floorSegmentMB=0.29296875, forceMergeDeletesPctAllowed=17.287363853457354, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 656319 T3300 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@f6935c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@450b72),segFN=segments_1,generation=1}
[junit4] 2> 656319 T3347 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 656319 T3300 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 656321 T3331 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 656321 T3331 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 656321 T3347 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 656322 T3331 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 656322 T3347 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 656322 T3300 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 656322 T3331 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 656323 T3347 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=63930258, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 656323 T3300 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 656323 T3347 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@17e21b6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@132ea21),segFN=segments_1,generation=1}
[junit4] 2> 656324 T3347 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 656323 T3331 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 656324 T3347 oass.SolrIndexSearcher.<init> Opening Searcher@2d708c main
[junit4] 2> 656323 T3300 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 656324 T3331 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 656325 T3279 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 656325 T3300 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 656325 T3331 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 656326 T3300 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 656326 T3300 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 656326 T3331 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 656327 T3300 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 656327 T3361 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@2d708c main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 656327 T3331 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 656327 T3300 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 656328 T3331 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 656328 T3347 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
[junit4] 2> 656328 T3331 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 656329 T3331 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 656328 T3300 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 656329 T3331 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 656329 T3300 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 656330 T3331 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 656330 T3300 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 656330 T3300 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 656328 T3347 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica1 address:http://127.0.0.1:55428/_oao collection:solrj_collection shard:shard2
[junit4] 2> 656328 T3279 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 656331 T3300 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 656330 T3331 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 656332 T3347 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
[junit4] 2> 656332 T3331 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 656332 T3300 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 656332 T3331 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 656333 T3300 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 656333 T3300 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 656334 T3331 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 656334 T3279 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 656334 T3300 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 656335 T3279 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 656335 T3279 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 656335 T3279 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 656335 T3331 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 656335 T3300 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 656336 T3331 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 656336 T3279 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 656337 T3279 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 656337 T3331 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=63930258, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 656337 T3347 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 656338 T3331 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@14147fe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@72d757),segFN=segments_1,generation=1}
[junit4] 2> 656338 T3300 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 656338 T3331 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 656337 T3279 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 656339 T3331 oass.SolrIndexSearcher.<init> Opening Searcher@c294ae main
[junit4] 2> 656339 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 656339 T3300 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 656340 T3347 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=179999
[junit4] 2> 656340 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 656339 T3279 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/solrj_collection_shard1_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/solrj_collection_shard1_replica1/data/
[junit4] 2> 656341 T3286 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 656341 T3287 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 656340 T3300 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=63930258, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 656341 T3363 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica2] Registered new searcher Searcher@c294ae main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 656341 T3279 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ff34
[junit4] 2> 656342 T3300 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@f6935c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@450b72),segFN=segments_1,generation=1}
[junit4] 2> 656342 T3300 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 656342 T3300 oass.SolrIndexSearcher.<init> Opening Searcher@73ad8e main
[junit4] 2> 656342 T3279 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/solrj_collection_shard1_replica1/data
[junit4] 2> 656343 T3331 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica2
[junit4] 2> 656343 T3279 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 656343 T3331 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica2 address:http://127.0.0.1:37935/_oao collection:solrj_collection shard:shard1
[junit4] 2> 656344 T3279 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1388847451956/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 656344 T3279 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDi
[...truncated too long message...]
cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/nodes_used_collection_shard2_replica1/data/index [CachedDir<<refCount=0;path=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/nodes_used_collection_shard2_replica1/data/index;done=false>>]
[junit4] 2> 757030 T3339 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/nodes_used_collection_shard2_replica1/data/index
[junit4] 2> 757030 T3339 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/nodes_used_collection_shard2_replica1/data [CachedDir<<refCount=0;path=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/nodes_used_collection_shard2_replica1/data;done=false>>]
[junit4] 2> 757030 T3339 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1388847454395/nodes_used_collection_shard2_replica1/data
[junit4] 2> 757030 T3339 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4] 2> 757031 T3339 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:413)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 757031 T3339 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/nodes_used_collection/leader_elect/shard2/election/91019506495848460-core_node2-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:276)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 757032 T3339 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 757032 T3339 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 757032 T3339 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 757032 T3339 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 757032 T3339 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=es_PY, timezone=Europe/Brussels
[junit4] 2> NOTE: Linux 3.8.0-35-generic i386/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=8,threads=1,free=139380736,total=352845824
[junit4] 2> NOTE: All tests run in this JVM: [SuggesterWFSTTest, TestOmitPositions, TestStressLucene, DocValuesMultiTest, BasicZkTest, PluginInfoTest, HardAutoCommitTest, MigrateRouteKeyTest, TestRTGBase, PrimUtilsTest, CachingDirectoryFactoryTest, TestCSVLoader, TestZkChroot, AbstractAnalyticsStatsTest, RAMDirectoryFactoryTest, ConnectionManagerTest, TestFuzzyAnalyzedSuggestions, ZkNodePropsTest, DirectSolrConnectionTest, TestCSVResponseWriter, TestIndexingPerformance, TestRandomMergePolicy, TestAddFieldRealTimeGet, SolrIndexConfigTest, TestFieldTypeCollectionResource, ZkSolrClientTest, TestFoldingMultitermQuery, AddSchemaFieldsUpdateProcessorFactoryTest, PreAnalyzedFieldTest, BlockDirectoryTest, TestDFRSimilarityFactory, OpenExchangeRatesOrgProviderTest, TestRandomFaceting, PreAnalyzedUpdateProcessorTest, TestNRTOpen, TestSchemaResource, TestUtils, DateFieldTest, LeaderElectionIntegrationTest, AssignTest, TestStressReorder, AddBlockUpdateTest, ChangedSchemaMergeTest, ShardRoutingCustomTest, DistributedQueryComponentCustomSortTest, TestHashPartitioner, TestUpdate, TestFieldResource, TestWordDelimiterFilterFactory, TestFiltering, TestCollationField, TestMultiCoreConfBootstrap, TestRangeQuery, TestDistributedSearch, BadCopyFieldTest, TestFieldTypeResource, FieldFacetTest, UniqFieldsUpdateProcessorFactoryTest, TestClassNameShortening, SuggesterTSTTest, MultiTermTest, ChaosMonkeyNothingIsSafeTest, TestSchemaNameResource, TestStressUserVersions, DistanceFunctionTest, TestFastLRUCache, TestBinaryResponseWriter, NotRequiredUniqueKeyTest, DocumentAnalysisRequestHandlerTest, XmlUpdateRequestHandlerTest, TestAtomicUpdateErrorCases, TestIndexSearcher, SignatureUpdateProcessorFactoryTest, BlockCacheTest, IndexBasedSpellCheckerTest, TestBinaryField, SolrCmdDistributorTest, TestCoreDiscovery, FieldFacetExtrasTest, OutputWriterTest, TimeZoneUtilsTest, TestManagedSchemaFieldResource, TermVectorComponentDistributedTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest]
[junit4] Completed on J1 in 109.72s, 1 test, 1 failure <<< FAILURES!
[...truncated 543 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:453: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:433: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1304: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:937: There were test failures: 358 suites, 1577 tests, 1 failure, 35 ignored (6 assumptions)
Total time: 40 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b02 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure