You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/03/12 18:37:05 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-fcs-b132) - Build
# 9770 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9770/
Java: 32bit/jdk1.8.0-fcs-b132 -server -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testShutdown
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
at __randomizedtesting.SeedInfo.seed([2F4932083F453DAA:CC3F3B9DD83FA8D8]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:860)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
... 45 more
Build Log:
[...truncated 11666 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> 7426 T58 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 7427 T58 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 7429 T58 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 7433 T58 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394645694740
[junit4] 2> 7436 T58 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 7438 T59 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 7538 T58 oasc.ZkTestServer.run start zk server on port:49741
[junit4] 2> 7584 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 58095 T62 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 50489ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 58095 T58 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 58104 T60 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144b75c79520000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 58107 T58 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49741 49741
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testShutdown -Dtests.seed=2F4932083F453DAA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sk -Dtests.timezone=Europe/Berlin -Dtests.file.encoding=UTF-8
[junit4] ERROR 51.5s J0 | CloudSolrServerTest.testShutdown <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
[junit4] > at __randomizedtesting.SeedInfo.seed([2F4932083F453DAA:CC3F3B9DD83FA8D8]:0)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
[junit4] > ... 45 more
[junit4] 2> 58890 T58 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394645746197
[junit4] 2> 58891 T58 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 58892 T66 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 58992 T58 oasc.ZkTestServer.run start zk server on port:38741
[junit4] 2> 58993 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 58999 T72 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16844ff name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59000 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59001 T58 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 59047 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59049 T74 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13a2ed8 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59050 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59055 T58 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 59060 T58 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 59064 T58 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 59067 T58 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 59071 T58 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 59071 T58 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 59087 T58 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 59089 T58 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 59093 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 59094 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 59094 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 59095 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 59095 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 59096 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 59096 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 59097 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 59097 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 59103 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59105 T76 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1609fc9 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59105 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59162 T58 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 59372 T58 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 59402 T58 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:39704
[junit4] 2> 59408 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 59409 T58 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 59409 T58 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414
[junit4] 2> 59409 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/'
[junit4] 2> 59426 T58 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/solr.xml
[junit4] 2> 59457 T58 oasc.CoreContainer.<init> New CoreContainer 30105253
[junit4] 2> 59458 T58 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/]
[junit4] 2> 59459 T58 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 59460 T58 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 59460 T58 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 59461 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 59461 T58 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 59461 T58 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 59462 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 59462 T58 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 59463 T58 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 59472 T58 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 59472 T58 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 59473 T58 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 59473 T58 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38741/solr
[junit4] 2> 59487 T58 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 59506 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59528 T87 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@169f53a name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59529 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59540 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59548 T89 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16a4980 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59549 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59562 T58 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 59576 T58 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 59640 T58 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 59643 T58 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39704_
[junit4] 2> 59646 T58 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39704_
[junit4] 2> 59650 T58 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 59653 T58 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 59663 T58 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:39704_
[junit4] 2> 59664 T58 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 59674 T58 oasc.Overseer.start Overseer (id=91399503622963204-127.0.0.1:39704_-n_0000000000) starting
[junit4] 2> 59752 T58 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 59786 T91 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 59787 T58 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 59797 T58 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 59797 T91 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 59808 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 59818 T90 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 59838 T92 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 59838 T92 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 59842 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 59842 T92 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 59856 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 59858 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39704",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39704_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 59858 T90 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 59880 T90 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 59883 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 59889 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 60843 T92 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 60843 T92 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/collection1
[junit4] 2> 60843 T92 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 60844 T92 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 60844 T92 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 60845 T92 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 60846 T92 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/collection1/'
[junit4] 2> 60879 T92 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 60903 T92 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 60905 T92 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 60931 T92 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 60950 T92 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 60957 T92 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 60963 T92 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 60969 T92 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 61207 T92 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 61209 T92 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 61211 T92 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 61211 T92 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 61215 T92 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 61216 T92 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/
[junit4] 2> 61216 T92 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 61217 T92 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data
[junit4] 2> 61218 T92 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index/
[junit4] 2> 61218 T92 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 61218 T92 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index
[junit4] 2> 61221 T92 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b87640 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 61221 T92 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 61223 T92 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 61223 T92 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 61223 T92 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 61223 T92 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 61224 T92 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 61224 T92 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 61224 T92 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 61225 T92 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 61227 T92 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 61229 T92 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 61229 T92 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 61230 T92 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b87640 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 61231 T92 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 61231 T92 oass.SolrIndexSearcher.<init> Opening Searcher@1309fac[collection1] main
[junit4] 2> 61232 T92 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 61233 T93 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1309fac[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 61236 T58 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 61236 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 61245 T96 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:39704 collection:control_collection shard:shard1
[junit4] 2> 61258 T96 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 61273 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 61280 T98 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a19e81 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 61280 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 61283 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 61285 T96 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 61291 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61292 T96 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 61292 T96 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 61293 T58 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> ASYNC NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@9e4dc3 url=https://127.0.0.1:39704/collection1 node=127.0.0.1:39704_ C8_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:39704, core=collection1, node_name=127.0.0.1:39704_}
[junit4] 2> 61294 T96 C8 P39704 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:39704/collection1/
[junit4] 2> 61295 T96 C8 P39704 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 61296 T96 C8 P39704 oasc.SyncStrategy.syncToMe https://127.0.0.1:39704/collection1/ has no replicas
[junit4] 2> 61296 T96 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:39704/collection1/ shard1
[junit4] 2> 61299 T96 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 61300 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 61306 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61309 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61341 T58 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 61343 T58 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 61349 T58 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 61355 T58 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:37866
[junit4] 2> 61358 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 61359 T58 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 61359 T58 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600
[junit4] 2> 61359 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/'
[junit4] 2> 61387 T58 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/solr.xml
[junit4] 2> 61402 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61404 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 61405 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 61420 T58 oasc.CoreContainer.<init> New CoreContainer 20249118
[junit4] 2> 61420 T58 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/]
[junit4] 2> 61421 T58 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 61422 T58 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 61422 T58 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 61423 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 61423 T58 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 61423 T58 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 61424 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 61424 T58 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 61425 T58 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 61433 T58 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 61433 T58 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 61446 T58 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 61446 T58 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38741/solr
[junit4] 2> 61449 T58 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 61451 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 61453 T109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14f67e4 name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 61454 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 61456 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 61458 T111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f30fe7 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 61459 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 61462 T96 oasc.ZkController.register We are https://127.0.0.1:39704/collection1/ and leader is https://127.0.0.1:39704/collection1/
[junit4] 2> 61462 T96 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:39704
[junit4] 2> 61462 T96 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 61462 T96 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 61463 T96 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 61465 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61466 T96 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 61468 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 61469 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:39704",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39704_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 61472 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61483 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 61574 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 61575 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 61574 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 62496 T58 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37866_
[junit4] 2> 62497 T58 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37866_
[junit4] 2> 62500 T98 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 62500 T111 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 62506 T89 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 62531 T112 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 62531 T112 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 62533 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62533 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62533 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62533 T112 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 62535 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 62536 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37866",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37866_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 62536 T90 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 62536 T90 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 62539 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62645 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 62648 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 62645 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63534 T112 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 63534 T112 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/collection1
[junit4] 2> 63534 T112 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 63535 T112 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 63535 T112 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 63537 T112 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 63537 T112 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/collection1/'
[junit4] 2> 63552 T112 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 63562 T112 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 63564 T112 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 63573 T112 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 63716 T112 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 63718 T112 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 63720 T112 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 63722 T112 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 63723 T112 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 63723 T112 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/
[junit4] 2> 63724 T112 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 63725 T112 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1
[junit4] 2> 63725 T112 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index/
[junit4] 2> 63725 T112 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 63725 T112 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index
[junit4] 2> 63727 T112 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@15ec1d7 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 63727 T112 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 63728 T112 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 63728 T112 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 63728 T112 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 63731 T112 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 63732 T112 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 63733 T112 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 63734 T112 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@15ec1d7 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 63734 T112 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 63734 T112 oass.SolrIndexSearcher.<init> Opening Searcher@1cb9680[collection1] main
[junit4] 2> 63735 T113 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1cb9680[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 63735 T112 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 63736 T58 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 63736 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 63736 T116 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:37866 collection:collection1 shard:shard2
[junit4] 2> 63738 T116 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 63745 T116 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 63746 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63747 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63747 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63747 T116 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 63747 T116 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@7e779c url=https://127.0.0.1:37866/collection1 node=127.0.0.1:37866_ C9_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:37866, core=collection1, node_name=127.0.0.1:37866_}
[junit4] 2> 63748 T116 C9 P37866 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:37866/collection1/
[junit4] 2> 63748 T116 C9 P37866 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 63748 T116 C9 P37866 oasc.SyncStrategy.syncToMe https://127.0.0.1:37866/collection1/ has no replicas
[junit4] 2> 63748 T116 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:37866/collection1/ shard2
[junit4] 2> 63749 T116 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 63749 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 63755 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63758 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63761 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63772 T58 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 63773 T58 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 63777 T58 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 63780 T58 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:48204
[junit4] 2> 63786 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 63787 T58 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 63787 T58 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044
[junit4] 2> 63788 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/'
[junit4] 2> 63802 T58 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/solr.xml
[junit4] 2> 63819 T58 oasc.CoreContainer.<init> New CoreContainer 14152122
[junit4] 2> 63819 T58 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/]
[junit4] 2> 63820 T58 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 63820 T58 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 63820 T58 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 63820 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 63821 T58 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 63821 T58 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 63821 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 63822 T58 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 63822 T58 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 63827 T58 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 63827 T58 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 63828 T58 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 63828 T58 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38741/solr
[junit4] 2> 63829 T58 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 63833 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 63836 T127 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ebeebf name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63837 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 63849 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 63851 T129 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e09bee name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63851 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 63857 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 63865 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63865 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63865 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63865 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63909 T116 oasc.ZkController.register We are https://127.0.0.1:37866/collection1/ and leader is https://127.0.0.1:37866/collection1/
[junit4] 2> 63909 T116 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:37866
[junit4] 2> 63909 T116 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 63909 T116 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 63909 T116 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 63911 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63911 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63911 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63911 T116 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 63913 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 63914 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:37866",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37866_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 63916 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64019 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 64019 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 64019 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 64019 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 64860 T58 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48204_
[junit4] 2> 64862 T58 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48204_
[junit4] 2> 64864 T98 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64865 T129 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64865 T111 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64866 T89 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64870 T130 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 64871 T130 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 64872 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64872 T130 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 64872 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64872 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64874 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 64875 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:48204",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48204_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 64875 T90 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 64875 T90 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 64877 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64990 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 64991 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 64990 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 64991 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65872 T130 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 65873 T130 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/collection1
[junit4] 2> 65873 T130 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 65874 T130 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 65874 T130 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 65875 T130 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 65875 T130 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/collection1/'
[junit4] 2> 65920 T130 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 65935 T130 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 65939 T130 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 65954 T130 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 66226 T130 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 66291 T130 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 66293 T130 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 66300 T130 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 66301 T130 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 66301 T130 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/
[junit4] 2> 66302 T130 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 66302 T130 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2
[junit4] 2> 66313 T130 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index/
[junit4] 2> 66314 T130 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 66314 T130 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index
[junit4] 2> 66316 T130 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@193123c lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 66316 T130 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 66318 T130 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 66318 T130 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 66318 T130 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 66318 T130 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 66319 T130 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 66319 T130 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 66319 T130 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 66320 T130 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 66322 T130 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 66334 T130 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 66335 T130 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 66336 T130 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@193123c lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 66336 T130 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 66336 T130 oass.SolrIndexSearcher.<init> Opening Searcher@a03467[collection1] main
[junit4] 2> 66337 T130 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 66338 T131 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a03467[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 66363 T58 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 66363 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 66369 T134 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:48204 collection:collection1 shard:shard1
[junit4] 2> 66372 T134 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 66381 T134 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 66383 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66383 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66384 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66384 T134 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 66384 T134 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C10 name=collection1 org.apache.solr.core.SolrCore@1dce71b url=https://127.0.0.1:48204/collection1 node=127.0.0.1:48204_ C10_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:48204, core=collection1, node_name=127.0.0.1:48204_}
[junit4] 2> 66384 T134 C10 P48204 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:48204/collection1/
[junit4] 2> 66385 T134 C10 P48204 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 66385 T134 C10 P48204 oasc.SyncStrategy.syncToMe https://127.0.0.1:48204/collection1/ has no replicas
[junit4] 2> 66385 T134 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:48204/collection1/ shard1
[junit4] 2> 66385 T134 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 66387 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 66391 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66393 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66397 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66419 T58 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 66421 T58 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 66501 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66501 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66501 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66503 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66516 T58 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 66524 T58 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49042
[junit4] 2> 66530 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 66531 T58 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 66531 T58 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672
[junit4] 2> 66531 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/'
[junit4] 2> 66544 T134 oasc.ZkController.register We are https://127.0.0.1:48204/collection1/ and leader is https://127.0.0.1:48204/collection1/
[junit4] 2> 66544 T134 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:48204
[junit4] 2> 66545 T134 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 66545 T134 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 66545 T134 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 66547 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66547 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66548 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66548 T134 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 66550 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 66550 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:48204",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48204_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 66553 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66576 T58 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/solr.xml
[junit4] 2> 66658 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66659 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66659 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66662 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66663 T58 oasc.CoreContainer.<init> New CoreContainer 15862707
[junit4] 2> 66664 T58 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/]
[junit4] 2> 66665 T58 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 66665 T58 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 66666 T58 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 66666 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 66666 T58 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 66667 T58 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 66667 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 66668 T58 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 66668 T58 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 66688 T58 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 66688 T58 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 66689 T58 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 66689 T58 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38741/solr
[junit4] 2> 66690 T58 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 66734 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 66736 T145 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cc04c0 name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 66737 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 66781 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 66785 T147 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@176d7f9 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 66786 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 66792 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 67796 T58 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49042_
[junit4] 2> 67797 T58 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49042_
[junit4] 2> 67800 T111 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67800 T89 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67800 T129 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67800 T147 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67800 T98 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67810 T148 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 67810 T148 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 67811 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67811 T148 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 67811 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67812 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67813 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 67815 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:49042",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49042_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 67816 T90 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 67816 T90 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 67820 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67937 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 67937 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 67937 T147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 67937 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 67938 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 68812 T148 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 68812 T148 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/collection1
[junit4] 2> 68812 T148 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 68813 T148 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 68813 T148 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 68814 T148 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 68814 T148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/collection1/'
[junit4] 2> 68849 T148 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 68866 T148 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 68879 T148 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 68912 T148 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 69082 T148 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 69084 T148 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 69086 T148 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 69086 T148 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 69087 T148 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 69087 T148 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/
[junit4] 2> 69088 T148 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 69089 T148 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3
[junit4] 2> 69089 T148 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index/
[junit4] 2> 69089 T148 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 69089 T148 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index
[junit4] 2> 69091 T148 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@174dc2 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 69091 T148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 69093 T148 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 69093 T148 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 69093 T148 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 69094 T148 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 69094 T148 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 69094 T148 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 69095 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 69095 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 69097 T148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 69100 T148 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 69100 T148 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 69101 T148 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@174dc2 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 69102 T148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 69102 T148 oass.SolrIndexSearcher.<init> Opening Searcher@f1ea64[collection1] main
[junit4] 2> 69104 T148 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 69104 T149 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f1ea64[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 69105 T58 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 69105 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 69105 T152 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:49042 collection:collection1 shard:shard2
[junit4] 2> 69122 T152 oasc.ZkController.register We are https://127.0.0.1:49042/collection1/ and leader is https://127.0.0.1:37866/collection1/
[junit4] 2> 69122 T152 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:49042
[junit4] 2> 69122 T152 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 69123 T152 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 69129 T152 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C11 name=collection1 org.apache.solr.core.SolrCore@93a5b2 url=https://127.0.0.1:49042/collection1 node=127.0.0.1:49042_ C11_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:49042, core=collection1, node_name=127.0.0.1:49042_}
[junit4] 2> 69130 T153 C11 P49042 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 69130 T153 C11 P49042 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 69131 T153 C11 P49042 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 69133 T153 C11 P49042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 69135 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69135 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69135 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeC
[...truncated too long message...]
, but Solr cannot talk to ZK
[junit4] 2> 82255 T147 C30 P49042 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 82261 T147 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 82261 T147 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@93a5b2
[junit4] 2> 82262 T147 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 82262 T147 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 82263 T147 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 82263 T147 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 82264 T147 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index;done=false>>]
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3;done=false>>]
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3
[junit4] 2> 82265 T147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 82266 T147 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 82266 T147 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 82266 T147 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> ASYNC NEW_CORE C32 name=collection1 org.apache.solr.core.SolrCore@106d42 url=https://127.0.0.1:40686/collection1 node=127.0.0.1:40686_ C32_STATE=coll:collection1 core:collection1 props:{state=active, base_url=https://127.0.0.1:40686, core=collection1, node_name=127.0.0.1:40686_}
[junit4] 2> 82376 T166 C32 P40686 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 82378 T166 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 82378 T166 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@106d42
[junit4] 2> 82379 T166 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 82380 T166 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 82380 T166 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 82380 T166 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 82383 T166 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 82384 T166 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 82384 T166 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4;done=false>>]
[junit4] 2> 82384 T166 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4
[junit4] 2> 82385 T166 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4/index;done=false>>]
[junit4] 2> 82385 T166 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4/index
[junit4] 2> 82385 T166 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 82387 T166 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=248), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=248)), sim=DefaultSimilarity, locale=sk, timezone=Europe/Berlin
[junit4] 2> NOTE: Linux 3.8.0-36-generic i386/Oracle Corporation 1.8.0 (32-bit)/cpus=8,threads=1,free=21947848,total=64880640
[junit4] 2> NOTE: All tests run in this JVM: [TestCoreAdmin, LargeVolumeBinaryJettyTest, TestXMLEscaping, CloudSolrServerTest]
[junit4] Completed on J0 in 75.93s, 2 tests, 1 error <<< FAILURES!
[...truncated 121 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 283 tests, 1 error
Total time: 50 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b132 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-fcs-b132)
- Build # 9770 - Failure!
Posted by Mark Miller <ma...@gmail.com>.
Where is @IgnoreOnlyOnPoliceman :)
We need to figure this out and address it - perhaps it can’t reclaim the same port? I don’t know why only on the policeman though, or why it just started out of the blue.
Somebody feel free to bad apple this testShutdown test method until someone has time to dig in. I won’t have much free time until this weekend.
--Â
Mark Miller
about.me/markrmiller
On March 12, 2014 at 10:38:19 AM, Policeman Jenkins Server (jenkins@thetaphi.de) wrote:
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9770/
Java: 32bit/jdk1.8.0-fcs-b132 -server -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testShutdown
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
at __randomizedtesting.SeedInfo.seed([2F4932083F453DAA:CC3F3B9DD83FA8D8]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:860)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
... 45 more
Build Log:
[...truncated 11666 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> 7426 T58 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 7427 T58 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 7429 T58 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 7433 T58 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394645694740
[junit4] 2> 7436 T58 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 7438 T59 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 7538 T58 oasc.ZkTestServer.run start zk server on port:49741
[junit4] 2> 7584 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 58095 T62 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 50489ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 58095 T58 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 58104 T60 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144b75c79520000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 58107 T58 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49741 49741
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testShutdown -Dtests.seed=2F4932083F453DAA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sk -Dtests.timezone=Europe/Berlin -Dtests.file.encoding=UTF-8
[junit4] ERROR 51.5s J0 | CloudSolrServerTest.testShutdown <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
[junit4] > at __randomizedtesting.SeedInfo.seed([2F4932083F453DAA:CC3F3B9DD83FA8D8]:0)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:49741 within 45000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
[junit4] > ... 45 more
[junit4] 2> 58890 T58 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394645746197
[junit4] 2> 58891 T58 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 58892 T66 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 58992 T58 oasc.ZkTestServer.run start zk server on port:38741
[junit4] 2> 58993 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 58999 T72 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16844ff name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59000 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59001 T58 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 59047 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59049 T74 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13a2ed8 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59050 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59055 T58 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 59060 T58 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 59064 T58 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 59067 T58 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 59071 T58 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 59071 T58 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 59087 T58 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 59089 T58 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 59093 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 59094 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 59094 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 59095 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 59095 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 59096 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 59096 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 59097 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 59097 T58 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 59103 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59105 T76 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1609fc9 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59105 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59162 T58 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 59372 T58 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 59402 T58 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:39704
[junit4] 2> 59408 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 59409 T58 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 59409 T58 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414
[junit4] 2> 59409 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/'
[junit4] 2> 59426 T58 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/solr.xml
[junit4] 2> 59457 T58 oasc.CoreContainer.<init> New CoreContainer 30105253
[junit4] 2> 59458 T58 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/]
[junit4] 2> 59459 T58 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 59460 T58 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 59460 T58 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 59461 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 59461 T58 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 59461 T58 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 59462 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 59462 T58 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 59463 T58 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 59472 T58 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 59472 T58 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 59473 T58 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 59473 T58 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38741/solr
[junit4] 2> 59487 T58 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 59506 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59528 T87 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@169f53a name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59529 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59540 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59548 T89 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16a4980 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59549 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59562 T58 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 59576 T58 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 59640 T58 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 59643 T58 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39704_
[junit4] 2> 59646 T58 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39704_
[junit4] 2> 59650 T58 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 59653 T58 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 59663 T58 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:39704_
[junit4] 2> 59664 T58 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 59674 T58 oasc.Overseer.start Overseer (id=91399503622963204-127.0.0.1:39704_-n_0000000000) starting
[junit4] 2> 59752 T58 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 59786 T91 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 59787 T58 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 59797 T58 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 59797 T91 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 59808 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 59818 T90 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 59838 T92 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 59838 T92 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 59842 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 59842 T92 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 59856 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 59858 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39704",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39704_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 59858 T90 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 59880 T90 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 59883 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 59889 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 60843 T92 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 60843 T92 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/collection1
[junit4] 2> 60843 T92 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 60844 T92 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 60844 T92 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 60845 T92 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 60846 T92 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/collection1/'
[junit4] 2> 60879 T92 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 60903 T92 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 60905 T92 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 60931 T92 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 60950 T92 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 60957 T92 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 60963 T92 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 60969 T92 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 61207 T92 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 61209 T92 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 61211 T92 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 61211 T92 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 61215 T92 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 61216 T92 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394645746414/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/
[junit4] 2> 61216 T92 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 61217 T92 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data
[junit4] 2> 61218 T92 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index/
[junit4] 2> 61218 T92 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 61218 T92 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index
[junit4] 2> 61221 T92 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b87640 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 61221 T92 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 61223 T92 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 61223 T92 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 61223 T92 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 61223 T92 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 61224 T92 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 61224 T92 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 61224 T92 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 61225 T92 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 61227 T92 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 61229 T92 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 61229 T92 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 61230 T92 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b87640 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 61231 T92 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 61231 T92 oass.SolrIndexSearcher.<init> Opening Searcher@1309fac[collection1] main
[junit4] 2> 61232 T92 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 61233 T93 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1309fac[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 61236 T58 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 61236 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 61245 T96 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:39704 collection:control_collection shard:shard1
[junit4] 2> 61258 T96 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 61273 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 61280 T98 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a19e81 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 61280 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 61283 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 61285 T96 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 61291 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61292 T96 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 61292 T96 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 61293 T58 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> ASYNC NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@9e4dc3 url=https://127.0.0.1:39704/collection1 node=127.0.0.1:39704_ C8_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:39704, core=collection1, node_name=127.0.0.1:39704_}
[junit4] 2> 61294 T96 C8 P39704 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:39704/collection1/
[junit4] 2> 61295 T96 C8 P39704 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 61296 T96 C8 P39704 oasc.SyncStrategy.syncToMe https://127.0.0.1:39704/collection1/ has no replicas
[junit4] 2> 61296 T96 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:39704/collection1/ shard1
[junit4] 2> 61299 T96 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 61300 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 61306 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61309 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61341 T58 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 61343 T58 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 61349 T58 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 61355 T58 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:37866
[junit4] 2> 61358 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 61359 T58 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 61359 T58 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600
[junit4] 2> 61359 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/'
[junit4] 2> 61387 T58 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/solr.xml
[junit4] 2> 61402 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61404 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 61405 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 61420 T58 oasc.CoreContainer.<init> New CoreContainer 20249118
[junit4] 2> 61420 T58 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/]
[junit4] 2> 61421 T58 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 61422 T58 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 61422 T58 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 61423 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 61423 T58 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 61423 T58 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 61424 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 61424 T58 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 61425 T58 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 61433 T58 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 61433 T58 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 61446 T58 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 61446 T58 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38741/solr
[junit4] 2> 61449 T58 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 61451 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 61453 T109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14f67e4 name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 61454 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 61456 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 61458 T111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f30fe7 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 61459 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 61462 T96 oasc.ZkController.register We are https://127.0.0.1:39704/collection1/ and leader is https://127.0.0.1:39704/collection1/
[junit4] 2> 61462 T96 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:39704
[junit4] 2> 61462 T96 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 61462 T96 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 61463 T96 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 61465 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61466 T96 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 61468 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 61469 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:39704",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39704_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 61472 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61483 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 61574 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 61575 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 61574 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 62496 T58 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37866_
[junit4] 2> 62497 T58 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37866_
[junit4] 2> 62500 T98 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 62500 T111 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 62506 T89 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 62531 T112 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 62531 T112 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 62533 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62533 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62533 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62533 T112 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 62535 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 62536 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37866",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37866_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 62536 T90 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 62536 T90 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 62539 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62645 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 62648 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 62645 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63534 T112 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 63534 T112 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/collection1
[junit4] 2> 63534 T112 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 63535 T112 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 63535 T112 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 63537 T112 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 63537 T112 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/collection1/'
[junit4] 2> 63552 T112 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 63562 T112 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 63564 T112 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 63573 T112 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 63716 T112 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 63718 T112 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 63720 T112 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 63722 T112 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 63723 T112 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 63723 T112 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394645748600/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/
[junit4] 2> 63724 T112 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 63725 T112 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1
[junit4] 2> 63725 T112 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index/
[junit4] 2> 63725 T112 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 63725 T112 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index
[junit4] 2> 63727 T112 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@15ec1d7 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 63727 T112 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 63728 T112 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 63728 T112 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 63728 T112 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 63729 T112 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 63731 T112 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 63732 T112 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 63733 T112 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 63734 T112 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@15ec1d7 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 63734 T112 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 63734 T112 oass.SolrIndexSearcher.<init> Opening Searcher@1cb9680[collection1] main
[junit4] 2> 63735 T113 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1cb9680[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 63735 T112 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 63736 T58 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 63736 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 63736 T116 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:37866 collection:collection1 shard:shard2
[junit4] 2> 63738 T116 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 63745 T116 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 63746 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63747 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63747 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63747 T116 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 63747 T116 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@7e779c url=https://127.0.0.1:37866/collection1 node=127.0.0.1:37866_ C9_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:37866, core=collection1, node_name=127.0.0.1:37866_}
[junit4] 2> 63748 T116 C9 P37866 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:37866/collection1/
[junit4] 2> 63748 T116 C9 P37866 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 63748 T116 C9 P37866 oasc.SyncStrategy.syncToMe https://127.0.0.1:37866/collection1/ has no replicas
[junit4] 2> 63748 T116 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:37866/collection1/ shard2
[junit4] 2> 63749 T116 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 63749 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 63755 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63758 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63761 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63772 T58 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 63773 T58 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 63777 T58 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 63780 T58 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:48204
[junit4] 2> 63786 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 63787 T58 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 63787 T58 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044
[junit4] 2> 63788 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/'
[junit4] 2> 63802 T58 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/solr.xml
[junit4] 2> 63819 T58 oasc.CoreContainer.<init> New CoreContainer 14152122
[junit4] 2> 63819 T58 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/]
[junit4] 2> 63820 T58 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 63820 T58 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 63820 T58 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 63820 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 63821 T58 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 63821 T58 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 63821 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 63822 T58 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 63822 T58 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 63827 T58 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 63827 T58 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 63828 T58 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 63828 T58 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38741/solr
[junit4] 2> 63829 T58 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 63833 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 63836 T127 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ebeebf name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63837 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 63849 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 63851 T129 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e09bee name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63851 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 63857 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 63865 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63865 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63865 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63865 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63909 T116 oasc.ZkController.register We are https://127.0.0.1:37866/collection1/ and leader is https://127.0.0.1:37866/collection1/
[junit4] 2> 63909 T116 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:37866
[junit4] 2> 63909 T116 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 63909 T116 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 63909 T116 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 63911 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63911 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63911 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63911 T116 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 63913 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 63914 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:37866",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37866_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 63916 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64019 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 64019 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 64019 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 64019 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 64860 T58 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48204_
[junit4] 2> 64862 T58 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48204_
[junit4] 2> 64864 T98 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64865 T129 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64865 T111 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64866 T89 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64870 T130 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 64871 T130 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 64872 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64872 T130 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 64872 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64872 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64874 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 64875 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:48204",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48204_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 64875 T90 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 64875 T90 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 64877 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64990 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 64991 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 64990 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 64991 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65872 T130 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 65873 T130 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/collection1
[junit4] 2> 65873 T130 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 65874 T130 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 65874 T130 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 65875 T130 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 65875 T130 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/collection1/'
[junit4] 2> 65920 T130 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 65935 T130 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 65939 T130 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 65954 T130 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 66226 T130 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 66291 T130 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 66293 T130 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 66300 T130 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 66301 T130 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 66301 T130 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394645751044/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/
[junit4] 2> 66302 T130 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 66302 T130 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2
[junit4] 2> 66313 T130 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index/
[junit4] 2> 66314 T130 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 66314 T130 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index
[junit4] 2> 66316 T130 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@193123c lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 66316 T130 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 66318 T130 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 66318 T130 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 66318 T130 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 66318 T130 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 66319 T130 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 66319 T130 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 66319 T130 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 66320 T130 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 66322 T130 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 66334 T130 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 66335 T130 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 66336 T130 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@193123c lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 66336 T130 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 66336 T130 oass.SolrIndexSearcher.<init> Opening Searcher@a03467[collection1] main
[junit4] 2> 66337 T130 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 66338 T131 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a03467[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 66363 T58 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 66363 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 66369 T134 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:48204 collection:collection1 shard:shard1
[junit4] 2> 66372 T134 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 66381 T134 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 66383 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66383 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66384 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66384 T134 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 66384 T134 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C10 name=collection1 org.apache.solr.core.SolrCore@1dce71b url=https://127.0.0.1:48204/collection1 node=127.0.0.1:48204_ C10_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:48204, core=collection1, node_name=127.0.0.1:48204_}
[junit4] 2> 66384 T134 C10 P48204 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:48204/collection1/
[junit4] 2> 66385 T134 C10 P48204 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 66385 T134 C10 P48204 oasc.SyncStrategy.syncToMe https://127.0.0.1:48204/collection1/ has no replicas
[junit4] 2> 66385 T134 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:48204/collection1/ shard1
[junit4] 2> 66385 T134 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 66387 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 66391 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66393 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66397 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66419 T58 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 66421 T58 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 66501 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66501 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66501 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66503 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66516 T58 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 66524 T58 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49042
[junit4] 2> 66530 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 66531 T58 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 66531 T58 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672
[junit4] 2> 66531 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/'
[junit4] 2> 66544 T134 oasc.ZkController.register We are https://127.0.0.1:48204/collection1/ and leader is https://127.0.0.1:48204/collection1/
[junit4] 2> 66544 T134 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:48204
[junit4] 2> 66545 T134 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 66545 T134 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 66545 T134 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 66547 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66547 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66548 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66548 T134 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 66550 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 66550 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:48204",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48204_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 66553 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66576 T58 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/solr.xml
[junit4] 2> 66658 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66659 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66659 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66662 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66663 T58 oasc.CoreContainer.<init> New CoreContainer 15862707
[junit4] 2> 66664 T58 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/]
[junit4] 2> 66665 T58 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 66665 T58 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 66666 T58 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 66666 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 66666 T58 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 66667 T58 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 66667 T58 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 66668 T58 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 66668 T58 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 66688 T58 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 66688 T58 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 66689 T58 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 66689 T58 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38741/solr
[junit4] 2> 66690 T58 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 66734 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 66736 T145 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cc04c0 name:ZooKeeperConnection Watcher:127.0.0.1:38741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 66737 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 66781 T58 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 66785 T147 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@176d7f9 name:ZooKeeperConnection Watcher:127.0.0.1:38741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 66786 T58 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 66792 T58 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 67796 T58 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49042_
[junit4] 2> 67797 T58 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49042_
[junit4] 2> 67800 T111 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67800 T89 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67800 T129 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67800 T147 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67800 T98 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 67810 T148 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 67810 T148 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 67811 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67811 T148 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 67811 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67812 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67813 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 67815 T90 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:49042",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49042_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 67816 T90 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 67816 T90 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 67820 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67937 T98 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 67937 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 67937 T147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 67937 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 67938 T89 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 68812 T148 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 68812 T148 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/collection1
[junit4] 2> 68812 T148 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 68813 T148 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 68813 T148 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 68814 T148 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 68814 T148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/collection1/'
[junit4] 2> 68849 T148 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 68866 T148 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 68879 T148 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 68912 T148 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 69082 T148 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 69084 T148 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 69086 T148 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 69086 T148 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 69087 T148 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 69087 T148 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394645753672/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/
[junit4] 2> 69088 T148 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 69089 T148 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3
[junit4] 2> 69089 T148 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index/
[junit4] 2> 69089 T148 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 69089 T148 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index
[junit4] 2> 69091 T148 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@174dc2 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 69091 T148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 69093 T148 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 69093 T148 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 69093 T148 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 69094 T148 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 69094 T148 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 69094 T148 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 69095 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 69095 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 69097 T148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 69100 T148 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 69100 T148 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 69101 T148 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@174dc2 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 69102 T148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 69102 T148 oass.SolrIndexSearcher.<init> Opening Searcher@f1ea64[collection1] main
[junit4] 2> 69104 T148 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 69104 T149 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f1ea64[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 69105 T58 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 69105 T58 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 69105 T152 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:49042 collection:collection1 shard:shard2
[junit4] 2> 69122 T152 oasc.ZkController.register We are https://127.0.0.1:49042/collection1/ and leader is https://127.0.0.1:37866/collection1/
[junit4] 2> 69122 T152 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:49042
[junit4] 2> 69122 T152 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 69123 T152 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 69129 T152 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C11 name=collection1 org.apache.solr.core.SolrCore@93a5b2 url=https://127.0.0.1:49042/collection1 node=127.0.0.1:49042_ C11_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:49042, core=collection1, node_name=127.0.0.1:49042_}
[junit4] 2> 69130 T153 C11 P49042 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 69130 T153 C11 P49042 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 69131 T153 C11 P49042 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 69133 T153 C11 P49042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 69135 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69135 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69135 T89 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeC
[...truncated too long message...]
, but Solr cannot talk to ZK
[junit4] 2> 82255 T147 C30 P49042 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 82261 T147 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 82261 T147 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@93a5b2
[junit4] 2> 82262 T147 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 82262 T147 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 82263 T147 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 82263 T147 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 82264 T147 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index;done=false>>]
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3/index
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3;done=false>>]
[junit4] 2> 82265 T147 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty3
[junit4] 2> 82265 T147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 82266 T147 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 82266 T147 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 82266 T147 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> ASYNC NEW_CORE C32 name=collection1 org.apache.solr.core.SolrCore@106d42 url=https://127.0.0.1:40686/collection1 node=127.0.0.1:40686_ C32_STATE=coll:collection1 core:collection1 props:{state=active, base_url=https://127.0.0.1:40686, core=collection1, node_name=127.0.0.1:40686_}
[junit4] 2> 82376 T166 C32 P40686 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 82378 T166 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 82378 T166 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@106d42
[junit4] 2> 82379 T166 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 82380 T166 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 82380 T166 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 82380 T166 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 82383 T166 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 82384 T166 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 82384 T166 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4;done=false>>]
[junit4] 2> 82384 T166 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4
[junit4] 2> 82385 T166 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4/index;done=false>>]
[junit4] 2> 82385 T166 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394645746197/jetty4/index
[junit4] 2> 82385 T166 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 82387 T166 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=248), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=248)), sim=DefaultSimilarity, locale=sk, timezone=Europe/Berlin
[junit4] 2> NOTE: Linux 3.8.0-36-generic i386/Oracle Corporation 1.8.0 (32-bit)/cpus=8,threads=1,free=21947848,total=64880640
[junit4] 2> NOTE: All tests run in this JVM: [TestCoreAdmin, LargeVolumeBinaryJettyTest, TestXMLEscaping, CloudSolrServerTest]
[junit4] Completed on J0 in 75.93s, 2 tests, 1 error <<< FAILURES!
[...truncated 121 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 283 tests, 1 error
Total time: 50 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b132 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org