You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/03/18 00:32:48 UTC
[JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 540 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/540/
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([40419D9356C66DC9:44491260446382E8]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:666)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
... 45 more
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:431)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:428)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:385)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:372)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
... 46 more
Build Log:
[...truncated 10806 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> 2173974 T3078 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 2173974 T3078 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solrtest-OverseerTest-1395097455127
[junit4] 2> 2173977 T3078 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 2173983 T3078 oas.SolrTestCaseJ4.setUp ###Starting testStateChange
[junit4] 2> 2173984 T3078 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2173985 T3079 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2174085 T3078 oasc.ZkTestServer.run start zk server on port:17226
[junit4] 2> 2174089 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2174098 T3085 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49414ab name:ZooKeeperConnection Watcher:127.0.0.1:17226/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2174099 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2174101 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2174113 T3087 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27a54c5a name:ZooKeeperConnection Watcher:127.0.0.1:17226 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2174114 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2174120 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2174123 T3089 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@669fd92c name:ZooKeeperConnection Watcher:127.0.0.1:17226 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2174127 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2174127 T3078 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2174136 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2174148 T3078 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2174157 T3078 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2174162 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2174171 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2174175 T3091 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2edbd6ca name:ZooKeeperConnection Watcher:127.0.0.1:17226/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2174175 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2174178 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2174187 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2174204 T3078 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:17226_solr
[junit4] 2> 2174205 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2174216 T3078 oasc.Overseer.start Overseer (id=91429106821169155-127.0.0.1:17226_solr-n_0000000000) starting
[junit4] 2> 2174219 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2174234 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2174245 T3078 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2174250 T3093 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2174252 T3093 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2174253 T3092 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2174257 T3092 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2174258 T3078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2174259 T3092 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2174260 T3092 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2174264 T3091 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2174266 T3085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2174310 T3078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2174313 T3091 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2174314 T3092 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2174315 T3092 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"}
[junit4] 2> 2174315 T3092 oasc.Overseer$ClusterStateUpdater.updateState node=core_node1 is already registered
[junit4] 2> 2174315 T3092 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2174318 T3091 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2174423 T3085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2174471 T3078 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:17226 17226
[junit4] 2> 2174731 T3078 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2174741 T3078 oas.SolrTestCaseJ4.setUp ###Starting testDoubleAssignment
[junit4] 2> 2174741 T3078 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2174742 T3095 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2174843 T3078 oasc.ZkTestServer.run start zk server on port:17232
[junit4] 2> 2174844 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2174851 T3101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30ed74ad name:ZooKeeperConnection Watcher:127.0.0.1:17232/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2174851 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2174852 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2174855 T3103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d6636b3 name:ZooKeeperConnection Watcher:127.0.0.1:17232 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2174856 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2174896 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2174899 T3105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@458f9d7a name:ZooKeeperConnection Watcher:127.0.0.1:17232 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2174899 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2174899 T3078 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2174904 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2174908 T3078 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2174912 T3078 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2174915 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2174920 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2174922 T3107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2136e1dd name:ZooKeeperConnection Watcher:127.0.0.1:17232/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2174923 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2174926 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2174931 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2174936 T3101 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2174936 T3107 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2174937 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2174939 T3109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bcb3421 name:ZooKeeperConnection Watcher:127.0.0.1:17232/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2174940 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2174944 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2174947 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2174955 T3078 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:17232_solr
[junit4] 2> 2174955 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2174959 T3078 oasc.Overseer.start Overseer (id=91429106870124548-127.0.0.1:17232_solr-n_0000000000) starting
[junit4] 2> 2174962 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2174968 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2174974 T3078 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2174977 T3111 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2174978 T3111 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2174979 T3110 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2174982 T3110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2174983 T3110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2174983 T3110 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 2174983 T3110 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2174988 T3109 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2174989 T3101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2174989 T3107 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2175481 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2175533 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2175567 T3109 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2175568 T3078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2175568 T3110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2175573 T3107 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2175573 T3101 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2175585 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2175593 T3109 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2175595 T3113 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@276f1691 name:ZooKeeperConnection Watcher:127.0.0.1:17232/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2175595 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2175596 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2175598 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2175608 T3101 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2175609 T3113 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2175618 T3109 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2175618 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2175619 T3110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2175620 T3110 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2175622 T3109 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2175625 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2175629 T3109 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2175632 T3109 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2175744 T3113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2175744 T3101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2175744 T3078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2175763 T3113 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2175763 T3101 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2175775 T3078 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:17232 17232
[junit4] 2> 2175863 T3078 oas.SolrTestCaseJ4.tearDown ###Ending testDoubleAssignment
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2175868 T3078 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4] 2> 2175869 T3078 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2175869 T3114 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2175970 T3078 oasc.ZkTestServer.run start zk server on port:17247
[junit4] 2> 2175971 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2175974 T3120 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fd7ad01 name:ZooKeeperConnection Watcher:127.0.0.1:17247/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2175974 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2175975 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2175977 T3122 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@183652ed name:ZooKeeperConnection Watcher:127.0.0.1:17247 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2175977 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2176046 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2176059 T3124 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b83e3f name:ZooKeeperConnection Watcher:127.0.0.1:17247 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2176060 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2176060 T3078 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2176077 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2176081 T3078 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2176092 T3078 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2176099 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2176102 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2176115 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2176123 T3126 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2211d254 name:ZooKeeperConnection Watcher:127.0.0.1:17247/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2176123 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2176124 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2176126 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2176143 T3078 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:17247_solr
[junit4] 2> 2176143 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2176147 T3078 oasc.Overseer.start Overseer (id=91429106943787011-127.0.0.1:17247_solr-n_0000000000) starting
[junit4] 2> 2176149 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2176167 T3078 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2176170 T3128 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2176171 T3128 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2176179 T3127 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2176179 T3127 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 2176180 T3127 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2176182 T3120 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2176184 T3127 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2176193 T3120 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2176195 T3127 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2176196 T3127 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2176197 T3127 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2176205 T3126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2176206 T3120 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2176281 T3115 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144d249d1840003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 2176284 T3078 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:17247 17247
[junit4] 2> 2176413 T3078 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2176418 T3078 oas.SolrTestCaseJ4.setUp ###Starting testBadQueueItem
[junit4] 2> 2176418 T3078 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2176419 T3129 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2176520 T3078 oasc.ZkTestServer.run start zk server on port:17252
[junit4] 2> 2176521 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2176525 T3135 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41c268cf name:ZooKeeperConnection Watcher:127.0.0.1:17252 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2176525 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2176604 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2176613 T3137 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66cb1cea name:ZooKeeperConnection Watcher:127.0.0.1:17252 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2176613 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2176614 T3078 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2176624 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2176634 T3139 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4387e6f5 name:ZooKeeperConnection Watcher:127.0.0.1:17252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2176634 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2176635 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2176643 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2176652 T3141 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68f2cce name:ZooKeeperConnection Watcher:127.0.0.1:17252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2176653 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2176654 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2176661 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2176672 T3078 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:17252_solr
[junit4] 2> 2176672 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2176675 T3078 oasc.Overseer.start Overseer (id=91429106979962883-127.0.0.1:17252_solr-n_0000000000) starting
[junit4] 2> 2176686 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2176689 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2176692 T3078 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2176694 T3143 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2176694 T3078 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2176694 T3143 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2176694 T3142 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2176696 T3078 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2176697 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2176699 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2176701 T3145 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62c524b8 name:ZooKeeperConnection Watcher:127.0.0.1:17252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2176701 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2176702 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2176704 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
[junit4] 2> 2176706 T3139 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2176706 T3145 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2176708 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2176709 T3142 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2176710 T3142 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2176710 T3142 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 2176710 T3142 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2176712 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2176713 T3145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2176713 T3139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2177209 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2177217 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2177222 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2177239 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2177239 T3142 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2177259 T3142 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2177259 T3142 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2177259 T3142 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 2177272 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2177432 T3139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2177432 T3145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2177740 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 2177766 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 2177771 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2177771 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2177772 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2177773 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2177773 T3142 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2177778 T3142 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2177778 T3142 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2177778 T3142 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2177790 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2177893 T3139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2177893 T3145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2178274 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2178304 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2178320 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178320 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178320 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178323 T3142 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2178329 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178433 T3145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2178433 T3139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2178478 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178478 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178478 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178489 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178489 T3142 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2178492 T3142 oasc.Overseer$ClusterStateUpdater.checkKeyExistence ERROR Skipping invalid Overseer message because it has no collection specified: {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":"",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2178507 T3142 oasc.Overseer$ClusterStateUpdater.checkKeyExistence ERROR Skipping invalid Overseer message because it has no collection specified: {
[junit4] 2> "operation":"deletecore",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":""}
[junit4] 2> 2178517 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178519 T3142 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2178519 T3142 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection2 with shards [shard1, shard2, shard3]
[junit4] 2> 2178519 T3142 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2178524 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2178628 T3139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2178628 T3145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2179004 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard2/election
[junit4] 2> 2179187 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard2
[junit4] 2> 2179203 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179204 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179204 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179214 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179214 T3142 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2179221 T3142 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2179222 T3142 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2179222 T3142 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 2179231 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179335 T3139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2179335 T3145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2179715 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard3/election
[junit4] 2> 2179747 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard3
[junit4] 2> 2179754 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179755 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179755 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179775 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179775 T3142 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2179783 T3142 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2179784 T3142 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2179784 T3142 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2179788 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2179896 T3145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2179896 T3139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2180272 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard1/election
[junit4] 2> 2180278 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard1
[junit4] 2> 2180282 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2180283 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2180283 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2180284 T3142 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2180286 T3141 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2180389 T3145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2180389 T3139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2180438 T3145 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2180440 T3078 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:17252 17252
[junit4] 2> 2180642 T3078 oas.SolrTestCaseJ4.tearDown ###Ending testBadQueueItem
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2180648 T3078 oas.SolrTestCaseJ4.setUp ###Starting testPlaceholders
[junit4] 2> 2180648 T3078 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2180649 T3146 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2180750 T3078 oasc.ZkTestServer.run start zk server on port:17276
[junit4] 2> 2180751 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2180755 T3152 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@311b70a name:ZooKeeperConnection Watcher:127.0.0.1:17276/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2180755 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2180755 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2180757 T3154 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e769cfa name:ZooKeeperConnection Watcher:127.0.0.1:17276 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2180757 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2180887 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2180897 T3156 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f861004 name:ZooKeeperConnection Watcher:127.0.0.1:17276 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2180897 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2180898 T3078 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2180900 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2180908 T3078 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2180910 T3078 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2180912 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2180914 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2180921 T3158 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@422dd2a3 name:ZooKeeperConnection Watcher:127.0.0.1:17276/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2180921 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2180922 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2180924 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2180926 T3152 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2180926 T3158 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2180927 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2180928 T3160 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2413b875 name:ZooKeeperConnection Watcher:127.0.0.1:17276/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2180928 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2180929 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2180931 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2180941 T3078 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:17276_solr
[junit4] 2> 2180941 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2180949 T3078 oasc.Overseer.start Overseer (id=91429107257180164-127.0.0.1:17276_solr-n_0000000000) starting
[junit4] 2> 2180951 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2180953 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2180956 T3078 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2180958 T3162 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2180958 T3162 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2180958 T3161 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2180960 T3161 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2180960 T3161 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"12",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2180961 T3161 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12]
[junit4] 2> 2180961 T3161 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2180962 T3160 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2180963 T3158 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2180963 T3152 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2181460 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2181482 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2181486 T3160 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2181487 T3078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2181488 T3161 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2181490 T3158 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2181491 T3152 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2181492 T3078 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:17276 17276
[junit4] 2> 2182589 T3078 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2182596 T3078 oas.SolrTestCaseJ4.setUp ###Starting testOverseerFailure
[junit4] 2> 2182596 T3078 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2182597 T3163 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2182698 T3078 oasc.ZkTestServer.run start zk server on port:17292
[junit4] 2> 2182699 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2182713 T3169 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59fefba5 name:ZooKeeperConnection Watcher:127.0.0.1:17292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2182714 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2182800 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2182810 T3171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e27ca5d name:ZooKeeperConnection Watcher:127.0.0.1:17292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2182810 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2182811 T3078 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2182830 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2182835 T3173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ad974a4 name:ZooKeeperConnection Watcher:127.0.0.1:17292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2182835 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2182836 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2182844 T3078 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2182854 T3078 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2182857 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2182862 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2182865 T3175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b749d9 name:ZooKeeperConnection Watcher:127.0.0.1:17292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2182865 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2182867 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2182871 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2182875 T3175 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2182875 T3173 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 2182876 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2182878 T3177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69557e67 name:ZooKeeperConnection Watcher:127.0.0.1:17292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2182879 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2182880 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2182883 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2182897 T3078 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:17292_solr
[junit4] 2> 2182898 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2182903 T3078 oasc.Overseer.start Overseer (id=91429107385040900-127.0.0.1:17292_solr-n_0000000000) starting
[junit4] 2> 2182906 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2182917 T3078 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2182923 T3078 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2182927 T3179 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2182929 T3179 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2182930 T3178 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2183932 T3177 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2183935 T3178 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2183936 T3178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2183937 T3178 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 2183937 T3178 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2183949 T3177 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2183951 T3175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2183951 T3173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2184433 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2184466 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2184500 T3177 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2184503 T3178 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2184505 T3078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2184517 T3177 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2184525 T3177 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2184526 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2184528 T3178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2184528 T3178 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2184539 T3177 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2184654 T3175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2184655 T3173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2185716 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2185729 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2185736 T3181 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@558de79b name:ZooKeeperConnection Watcher:127.0.0.1:17292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2185736 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2185745 T3078 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:17292_solr
[junit4] 2> 2185745 T3078 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2185757 T3078 oasc.Overseer.start Overseer (id=91429107385040901-127.0.0.1:17292_solr-n_0000000001) starting
[junit4] 2> 2185771 T3183 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2185772 T3183 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2185772 T3182 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2185774 T3182 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2185774 T3182 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2185775 T3182 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2185784 T3181 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2185784 T3175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2185785 T3173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2185838 T3181 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2185838 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2185839 T3182 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2185844 T3078 oasc.LeaderElector.checkIfIamLeader WARN Failed setting watch org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election/91429107385040899-node1_core1-n_0000000002
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:276)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:273)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
[junit4] 2> at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
[junit4] 2> at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:666)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 2185846 T3182 oasc.SolrException.log ERROR Problem cleaning up collection in zk:collection1:org.apache.zookeeper.KeeperException$NotEmptyException: KeeperErrorCode = Directory not empty for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:125)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:176)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:635)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:630)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:630)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:630)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.removeCore(Overseer.java:976)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.processMessage(Overseer.java:253)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:202)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 2185846 T3175 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2185847 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2185848 T3181 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2185852 T3181 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2185853 T3175 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2185853 T3182 oasc.Overseer$ClusterStateUpdater.setShardLeader ERROR Could not mark shard leader for non existing collection:collection1
[junit4] 2> 2185855 T3181 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2185858 T3181 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2185858 T3182 oasc.Overseer$ClusterStateUpdater.setShardLeader ERROR Could not mark shard leader for non existing collection:collection1
[junit4] 2> 2185870 T3181 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2185973 T3173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2185973 T3175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2186851 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2187855 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2188861 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2189873 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2190879 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2191883 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2192886 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2193892 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2194896 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2195900 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2196904 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2197910 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2198914 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2199918 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2200935 T3078 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2200943 T3175 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2200956 T3173 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2200961 T3078 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:17292 17292
[junit4] 2> 2202179 T3078 oas.SolrTestCaseJ4.tearDown ###Ending testOverseerFailure
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=OverseerTest -Dtests.method=testOverseerFailure -Dtests.seed=40419D9356C66DC9 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_GT -Dtests.timezone=Indian/Comoro -Dtests.file.encoding=UTF-8
[junit4] ERROR 19.6s J0 | OverseerTest.testOverseerFailure <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
[junit4] > at __randomizedtesting.SeedInfo.seed([40419D9356C66DC9:44491260446382E8]:0)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
[junit4] > at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
[junit4] > at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:666)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] > Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
[junit4] > at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
[junit4] > ... 45 more
[junit4] > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:431)
[junit4] > at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:428)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:385)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:372)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
[junit4] > at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
[junit4] > ... 46 more
[junit4] 2> 2202215 T3078 oas.SolrTestCaseJ4.setUp ###Starting testShardLeaderChange
[junit4] 2> 2202215 T3078 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2202216 T3184 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2202317 T3078 oasc.ZkTestServer.run start zk server on port:17369
[junit4] 2> 2202318 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2202327 T3190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e4a24cf name:ZooKeeperConnection Watcher:127.0.0.1:17369/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2202328 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2202329 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2202332 T3192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a9e0ea6 name:ZooKeeperConnection Watcher:127.0.0.1:17369 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2202333 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2202561 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2202564 T3194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d2f8fed name:ZooKeeperConnection Watcher:127.0.0.1:17369 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2202565 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2202565 T3078 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2202569 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2202583 T3195 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2202584 T3078 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2202587 T3198 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fa99c02 name:ZooKeeperConnection Watcher:127.0.0.1:17369/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2202587 T3195 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2202667 T3199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@584188c8 name:ZooKeeperConnection Watcher:127.0.0.1:17369/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2202667 T3195 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2202667 T3078 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2202669 T3078 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2202671 T3195 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2202692 T3078 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2202737 T3078 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2202739 T3195 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:17369_solr
[junit4] 2> 2202739 T3195 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2202741 T3078 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2202742 T3195 oasc.Overseer.start Overseer (id=91429108671053827-127.0.0.1:17369_solr-n_0000000000) starting
[junit4] 2> 2202752 T3199 oascc.ZkStateReader$3.process Updating live nodes..
[...truncated too long message...]
oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2225903 T3551 oasc.LeaderElector$1.process WARN org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.<init>(DistributedQueue.java:63)
[junit4] 2> at org.apache.solr.cloud.Overseer.getInQueue(Overseer.java:1130)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:146)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:225)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:222)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:222)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:100)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.<init>(DistributedQueue.java:61)
[junit4] 2> ... 8 more
[junit4] 2>
[junit4] 2> 2225904 T3551 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2225905 T3553 oasc.LeaderElector$1.process WARN org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leaders/shard12
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
[junit4] 2> ... 6 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leaders/shard12
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:455)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:385)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:372)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
[junit4] 2> ... 7 more
[junit4] 2>
[junit4] 2> 2225906 T3553 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2225906 T3553 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard11/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 2227474 T3078 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=es_GT, timezone=Indian/Comoro
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=49745824,total=300613632
[junit4] 2> NOTE: All tests run in this JVM: [LegacyHTMLStripCharFilterTest, TestSolrXmlPersistence, TestInfoStreamLogging, TestDocumentBuilder, TestConfig, QueryElevationComponentTest, ShardRoutingTest, FileBasedSpellCheckerTest, PreAnalyzedUpdateProcessorTest, TestComplexPhraseQParserPlugin, TestJoin, CircularListTest, DateMathParserTest, UpdateRequestProcessorFactoryTest, SimpleFacetsTest, ClusterStateUpdateTest, TestCollationKeyRangeQueries, EchoParamsTest, EnumFieldTest, TestDocSet, SliceStateTest, TestSchemaVersionResource, CursorPagingTest, SolrInfoMBeanTest, TermVectorComponentTest, TestGroupingSearch, TestLRUCache, ParsingFieldUpdateProcessorsTest, TestFileDictionaryLookup, MBeansHandlerTest, TestCharFilters, SuggesterFSTTest, CoreAdminHandlerTest, TestSimpleQParserPlugin, TestSort, TestRemoteStreaming, HdfsChaosMonkeySafeLeaderTest, TestRealTimeGet, SyncSliceTest, BinaryUpdateRequestHandlerTest, HdfsBasicDistributedZkTest, MoreLikeThisHandlerTest, DeleteShardTest, SchemaVersionSpecificBehaviorTest, SpellPossibilityIteratorTest, TestValueSourceCache, TestLMDirichletSimilarityFactory, TestLuceneMatchVersion, TestExpandComponent, TestTrie, TestInitQParser, TestJmxMonitoredMap, TestCloudManagedSchemaAddField, CustomCollectionTest, TermsComponentTest, BasicDistributedZkTest, TestCoreContainer, DocumentBuilderTest, UpdateParamsTest, TestPseudoReturnFields, LoggingHandlerTest, PeerSyncTest, TestBadConfig, TestMergePolicyConfig, TestSolrDeletionPolicy1, OverseerTest]
[junit4] Completed on J0 in 53.55s, 9 tests, 1 error <<< FAILURES!
[...truncated 654 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:474: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/common-build.xml:490: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1276: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:908: There were test failures: 371 suites, 1590 tests, 1 error, 35 ignored (7 assumptions)
Total time: 130 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 543 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/543/
2 tests failed.
REGRESSION: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1395472018108,generation=2,filelist=[_3.fdt, _3.fdx, _3.fnm, _3.si, _3_Lucene41_0.doc, _3_Lucene41_0.tim, _3_Lucene41_0.tip, _3_nrm.cfe, _3_nrm.cfs, _4.cfe, _4.cfs, _4.si, _5.cfe, _5.cfs, _5.si, _6.cfe, _6.cfs, _6.si, segments_2]}]> but was:<[{indexVersion=1395472018108,generation=2,filelist=[_3.fdt, _3.fdx, _3.fnm, _3.si, _3_Lucene41_0.doc, _3_Lucene41_0.tim, _3_Lucene41_0.tip, _3_nrm.cfe, _3_nrm.cfs, _4.cfe, _4.cfs, _4.si, _5.cfe, _5.cfs, _5.si, _6.cfe, _6.cfs, _6.si, segments_2]}, {indexVersion=1395472018108,generation=3,filelist=[_3.fdt, _3.fdx, _3.fnm, _3.si, _3_Lucene41_0.doc, _3_Lucene41_0.tim, _3_Lucene41_0.tip, _3_nrm.cfe, _3_nrm.cfs, _7.cfe, _7.cfs, _7.si, segments_3]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1395472018108,generation=2,filelist=[_3.fdt, _3.fdx, _3.fnm, _3.si, _3_Lucene41_0.doc, _3_Lucene41_0.tim, _3_Lucene41_0.tip, _3_nrm.cfe, _3_nrm.cfs, _4.cfe, _4.cfs, _4.si, _5.cfe, _5.cfs, _5.si, _6.cfe, _6.cfs, _6.si, segments_2]}]> but was:<[{indexVersion=1395472018108,generation=2,filelist=[_3.fdt, _3.fdx, _3.fnm, _3.si, _3_Lucene41_0.doc, _3_Lucene41_0.tim, _3_Lucene41_0.tip, _3_nrm.cfe, _3_nrm.cfs, _4.cfe, _4.cfs, _4.si, _5.cfe, _5.cfs, _5.si, _6.cfe, _6.cfs, _6.si, segments_2]}, {indexVersion=1395472018108,generation=3,filelist=[_3.fdt, _3.fdx, _3.fnm, _3.si, _3_Lucene41_0.doc, _3_Lucene41_0.tim, _3_Lucene41_0.tip, _3_nrm.cfe, _3_nrm.cfs, _7.cfe, _7.cfs, _7.si, segments_3]}]>
at __randomizedtesting.SeedInfo.seed([B22E9EB696E1F0C0:97F98586E6A9FEC3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1201)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:724)
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch
Error Message:
IOException occured when talking to server at: http://127.0.0.1:10784/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:10784/collection1
at __randomizedtesting.SeedInfo.seed([B22E9EB696E1F0C0:33C810AEE1BE90FC]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:516)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:203)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.compareResults(AbstractFullDistribZkTestBase.java:1340)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.compareResults(AbstractFullDistribZkTestBase.java:1292)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:415)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:145)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:724)
Caused by: java.net.SocketException: Broken pipe
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:159)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.writeLine(AbstractSessionOutputBuffer.java:258)
at org.apache.http.impl.io.HttpRequestWriter.writeHeadLine(HttpRequestWriter.java:59)
at org.apache.http.impl.io.HttpRequestWriter.writeHeadLine(HttpRequestWriter.java:46)
at org.apache.http.impl.io.AbstractMessageWriter.write(AbstractMessageWriter.java:109)
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestHeader(AbstractHttpClientConnection.java:254)
at org.apache.http.impl.conn.DefaultClientConnection.sendRequestHeader(DefaultClientConnection.java:270)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestHeader(ManagedClientConnectionImpl.java:209)
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:203)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:121)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:402)
... 48 more
Build Log:
[...truncated 10783 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> 753454 T4823 oas.SolrTestCaseJ4.setUp ###Starting doTestReplicateAfterWrite2Slave
[junit4] 2> 753471 T4823 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 753476 T4823 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:11970
[junit4] 2> 753476 T4823 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 753477 T4823 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 753477 T4823 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master
[junit4] 2> 753478 T4823 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/'
[junit4] 2> 753515 T4823 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/solr.xml
[junit4] 2> 753606 T4823 oasc.CoreContainer.<init> New CoreContainer 154824919
[junit4] 2> 753607 T4823 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/]
[junit4] 2> 753609 T4823 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 753609 T4823 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 753609 T4823 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 753610 T4823 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 753610 T4823 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 753610 T4823 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 753611 T4823 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 753611 T4823 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 753612 T4823 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 753612 T4823 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 753613 T4823 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 753613 T4823 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 753619 T4833 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/collection1
[junit4] 2> 753619 T4833 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/collection1/'
[junit4] 2> 753671 T4833 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 753731 T4833 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 753732 T4833 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 753738 T4833 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 753761 T4833 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 753762 T4833 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 753763 T4833 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/collection1/data/
[junit4] 2> 753763 T4833 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 753763 T4833 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/collection1/data
[junit4] 2> 753764 T4833 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/collection1/data/index/
[junit4] 2> 753764 T4833 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 753766 T4833 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495523/master/collection1/data/index
[junit4] 2> 753766 T4833 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.986328125, noCFSRatio=0.0]
[junit4] 2> 753769 T4833 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/index3188231914tmp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6c1b00bb),segFN=segments_1,generation=1}
[junit4] 2> 753769 T4833 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 753770 T4833 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 753770 T4833 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 753771 T4833 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 753771 T4833 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 753771 T4833 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 753772 T4833 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 753772 T4833 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 753788 T4833 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 753791 T4833 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 753792 T4833 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 753792 T4833 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=3, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5008686230892523]
[junit4] 2> 753794 T4833 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/index3188231914tmp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6c1b00bb),segFN=segments_1,generation=1}
[junit4] 2> 753795 T4833 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 753795 T4833 oass.SolrIndexSearcher.<init> Opening Searcher@73056c4a[collection1] main
[junit4] 2> 753795 T4833 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 753796 T4833 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 753796 T4834 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@73056c4a[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 753797 T4833 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 753797 T4823 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0
[junit4] 2> 753798 T4823 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 753809 T4823 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 753812 T4823 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55311
[junit4] 2> 753812 T4823 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 753813 T4823 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 753813 T4823 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave
[junit4] 2> 753813 T4823 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/'
[junit4] 2> 753828 T4823 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/solr.xml
[junit4] 2> 753898 T4823 oasc.CoreContainer.<init> New CoreContainer 113188989
[junit4] 2> 753898 T4823 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/]
[junit4] 2> 753900 T4823 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 753900 T4823 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 753901 T4823 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 753901 T4823 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 753902 T4823 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 753902 T4823 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 753902 T4823 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 753903 T4823 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 753903 T4823 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 753904 T4823 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 753904 T4823 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 753905 T4823 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 753910 T4845 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/collection1
[junit4] 2> 753911 T4845 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/collection1/'
[junit4] 2> 753962 T4845 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 754021 T4845 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 754022 T4845 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 754028 T4845 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 754046 T4845 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 754048 T4845 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 754048 T4845 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/collection1/data/
[junit4] 2> 754048 T4845 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 754049 T4845 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/collection1/data
[junit4] 2> 754049 T4845 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/collection1/data/index/
[junit4] 2> 754050 T4845 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 754051 T4845 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1395471495867/slave/collection1/data/index
[junit4] 2> 754052 T4845 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.986328125, noCFSRatio=0.0]
[junit4] 2> 754054 T4845 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/index3188231915tmp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3c007c0b),segFN=segments_1,generation=1}
[junit4] 2> 754055 T4845 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 754056 T4845 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 754056 T4845 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 754056 T4845 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 754057 T4845 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 754057 T4845 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 754057 T4845 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 754057 T4845 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 754059 T4845 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 754062 T4845 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 754063 T4845 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 754063 T4845 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=3, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5008686230892523]
[junit4] 2> 754065 T4845 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/index3188231915tmp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3c007c0b),segFN=segments_1,generation=1}
[junit4] 2> 754065 T4845 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 754066 T4845 oass.SolrIndexSearcher.<init> Opening Searcher@7da49145[collection1] main
[junit4] 2> 754072 T4845 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4] 2> 754072 T4846 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7da49145[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 754073 T4845 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 754074 T4823 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0
[junit4] 2> 754074 T4823 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> ASYNC NEW_CORE C551 name=collection1 org.apache.solr.core.SolrCore@dad18e4
[junit4] 2> 754077 T4826 C551 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={version=2&wt=javabin&sort=id+desc&q=*:*} hits=0 status=0 QTime=1
[junit4] 2> 754083 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[0]} 0 3
[junit4] 2> 754085 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[1]} 0 0
[junit4] 2> 754088 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[2]} 0 0
[junit4] 2> 754091 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[3]} 0 0
[junit4] 2> 754094 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[4]} 0 0
[junit4] 2> 754097 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[5]} 0 0
[junit4] 2> 754100 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[6]} 0 0
[junit4] 2> 754103 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[7]} 0 0
[junit4] 2> 754106 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[8]} 0 0
[junit4] 2> 754109 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[9]} 0 0
[junit4] 2> 754112 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[10]} 0 0
[junit4] 2> 754115 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[11]} 0 0
[junit4] 2> 754118 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[12]} 0 0
[junit4] 2> 754121 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[13]} 0 0
[junit4] 2> 754124 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[14]} 0 0
[junit4] 2> 754127 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[15]} 0 0
[junit4] 2> 754130 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[16]} 0 0
[junit4] 2> 754133 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[17]} 0 0
[junit4] 2> 754136 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[18]} 0 0
[junit4] 2> 754139 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[19]} 0 0
[junit4] 2> 754142 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[20]} 0 0
[junit4] 2> 754145 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[21]} 0 0
[junit4] 2> 754148 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[22]} 0 0
[junit4] 2> 754151 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[23]} 0 0
[junit4] 2> 754154 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[24]} 0 0
[junit4] 2> 754157 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[25]} 0 0
[junit4] 2> 754160 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[26]} 0 0
[junit4] 2> 754163 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[27]} 0 0
[junit4] 2> 754166 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[28]} 0 0
[junit4] 2> 754169 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[29]} 0 0
[junit4] 2> 754172 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[30]} 0 0
[junit4] 2> 754175 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[31]} 0 0
[junit4] 2> 754178 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[32]} 0 0
[junit4] 2> 754181 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[33]} 0 0
[junit4] 2> 754184 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[34]} 0 0
[junit4] 2> 754187 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[35]} 0 0
[junit4] 2> 754190 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[36]} 0 0
[junit4] 2> 754193 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[37]} 0 0
[junit4] 2> 754196 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[38]} 0 0
[junit4] 2> 754199 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[39]} 0 0
[junit4] 2> 754202 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[40]} 0 0
[junit4] 2> 754205 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[41]} 0 0
[junit4] 2> 754208 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[42]} 0 0
[junit4] 2> 754211 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[43]} 0 0
[junit4] 2> 754214 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[44]} 0 0
[junit4] 2> 754217 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[45]} 0 0
[junit4] 2> 754220 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[46]} 0 0
[junit4] 2> 754223 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[47]} 0 0
[junit4] 2> 754226 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[48]} 0 0
[junit4] 2> 754229 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[49]} 0 0
[junit4] 2> 754232 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[50]} 0 0
[junit4] 2> 754235 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[51]} 0 0
[junit4] 2> 754238 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[52]} 0 0
[junit4] 2> 754241 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[53]} 0 0
[junit4] 2> 754244 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[54]} 0 0
[junit4] 2> 754247 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[55]} 0 0
[junit4] 2> 754250 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[56]} 0 0
[junit4] 2> 754253 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[57]} 0 0
[junit4] 2> 754256 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[58]} 0 0
[junit4] 2> 754259 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[59]} 0 0
[junit4] 2> 754262 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[60]} 0 0
[junit4] 2> 754265 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[61]} 0 0
[junit4] 2> 754268 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[62]} 0 0
[junit4] 2> 754271 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[63]} 0 0
[junit4] 2> 754274 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[64]} 0 0
[junit4] 2> 754277 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[65]} 0 0
[junit4] 2> 754280 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[66]} 0 0
[junit4] 2> 754283 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[67]} 0 0
[junit4] 2> 754286 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[68]} 0 0
[junit4] 2> 754289 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[69]} 0 0
[junit4] 2> 754292 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[70]} 0 0
[junit4] 2> 754295 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[71]} 0 0
[junit4] 2> 754298 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[72]} 0 0
[junit4] 2> 754301 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[73]} 0 0
[junit4] 2> 754304 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[74]} 0 0
[junit4] 2> 754307 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[75]} 0 0
[junit4] 2> 754310 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[76]} 0 0
[junit4] 2> 754313 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[77]} 0 0
[junit4] 2> 754316 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[78]} 0 0
[junit4] 2> 754319 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[79]} 0 0
[junit4] 2> 754322 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[80]} 0 0
[junit4] 2> 754325 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[81]} 0 0
[junit4] 2> 754328 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[82]} 0 0
[junit4] 2> 754331 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[83]} 0 0
[junit4] 2> 754334 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[84]} 0 0
[junit4] 2> 754337 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[85]} 0 0
[junit4] 2> 754340 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[86]} 0 0
[junit4] 2> 754343 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[87]} 0 0
[junit4] 2> 754346 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[88]} 0 0
[junit4] 2> 754349 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[89]} 0 0
[junit4] 2> 754352 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[90]} 0 0
[junit4] 2> 754355 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[91]} 0 0
[junit4] 2> 754358 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[92]} 0 0
[junit4] 2> 754361 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[93]} 0 0
[junit4] 2> 754364 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[94]} 0 0
[junit4] 2> 754367 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[95]} 0 0
[junit4] 2> 754370 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[96]} 0 0
[junit4] 2> 754373 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[97]} 0 0
[junit4] 2> 754376 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[98]} 0 0
[junit4] 2> 754379 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[99]} 0 0
[junit4] 2> 754382 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[100]} 0 0
[junit4] 2> 754385 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[101]} 0 0
[junit4] 2> 754388 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[102]} 0 0
[junit4] 2> 754391 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[103]} 0 0
[junit4] 2> 754394 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[104]} 0 0
[junit4] 2> 754397 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[105]} 0 0
[junit4] 2> 754400 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[106]} 0 0
[junit4] 2> 754403 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[107]} 0 0
[junit4] 2> 754406 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[108]} 0 0
[junit4] 2> 754409 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[109]} 0 0
[junit4] 2> 754412 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[110]} 0 0
[junit4] 2> 754415 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[111]} 0 0
[junit4] 2> 754418 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[112]} 0 0
[junit4] 2> 754421 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[113]} 0 0
[junit4] 2> 754424 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[114]} 0 0
[junit4] 2> 754427 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[115]} 0 0
[junit4] 2> 754430 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[116]} 0 0
[junit4] 2> 754433 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[117]} 0 0
[junit4] 2> 754436 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[118]} 0 0
[junit4] 2> 754439 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[119]} 0 0
[junit4] 2> 754442 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[120]} 0 0
[junit4] 2> 754445 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[121]} 0 0
[junit4] 2> 754448 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[122]} 0 0
[junit4] 2> 754451 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[123]} 0 0
[junit4] 2> 754454 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[124]} 0 0
[junit4] 2> 754457 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[125]} 0 0
[junit4] 2> 754460 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[126]} 0 0
[junit4] 2> 754464 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[127]} 0 1
[junit4] 2> 754466 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[128]} 0 0
[junit4] 2> 754469 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[129]} 0 0
[junit4] 2> 754472 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[130]} 0 0
[junit4] 2> 754475 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[131]} 0 0
[junit4] 2> 754478 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[132]} 0 0
[junit4] 2> 754481 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[133]} 0 0
[junit4] 2> 754484 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[134]} 0 0
[junit4] 2> 754487 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[135]} 0 0
[junit4] 2> 754490 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[136]} 0 0
[junit4] 2> 754493 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[137]} 0 0
[junit4] 2> 754496 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[138]} 0 0
[junit4] 2> 754499 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[139]} 0 0
[junit4] 2> 754502 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[140]} 0 0
[junit4] 2> 754505 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[141]} 0 0
[junit4] 2> 754508 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[142]} 0 0
[junit4] 2> 754511 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[143]} 0 0
[junit4] 2> 754514 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[144]} 0 0
[junit4] 2> 754517 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[145]} 0 0
[junit4] 2> 754520 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[146]} 0 0
[junit4] 2> 754523 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[147]} 0 0
[junit4] 2> 754526 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[148]} 0 0
[junit4] 2> 754529 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[149]} 0 0
[junit4] 2> 754532 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[150]} 0 0
[junit4] 2> 754535 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[151]} 0 0
[junit4] 2> 754538 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[152]} 0 0
[junit4] 2> 754541 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[153]} 0 0
[junit4] 2> 754544 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[154]} 0 0
[junit4] 2> 754547 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[155]} 0 0
[junit4] 2> 754550 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[156]} 0 0
[junit4] 2> 754553 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[157]} 0 0
[junit4] 2> 754556 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[158]} 0 0
[junit4] 2> 754559 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[159]} 0 0
[junit4] 2> 754562 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[160]} 0 0
[junit4] 2> 754565 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[161]} 0 0
[junit4] 2> 754568 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[162]} 0 0
[junit4] 2> 754571 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[163]} 0 0
[junit4] 2> 754574 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[164]} 0 0
[junit4] 2> 754577 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[165]} 0 0
[junit4] 2> 754580 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[166]} 0 0
[junit4] 2> 754583 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[167]} 0 0
[junit4] 2> 754586 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[168]} 0 0
[junit4] 2> 754589 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[169]} 0 0
[junit4] 2> 754592 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[170]} 0 0
[junit4] 2> 754595 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[171]} 0 0
[junit4] 2> 754598 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[172]} 0 0
[junit4] 2> 754601 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[173]} 0 0
[junit4] 2> 754604 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[174]} 0 0
[junit4] 2> 754607 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[175]} 0 0
[junit4] 2> 754610 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[176]} 0 0
[junit4] 2> 754613 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[177]} 0 0
[junit4] 2> 754616 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[178]} 0 0
[junit4] 2> 754619 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[179]} 0 0
[junit4] 2> 754622 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[180]} 0 0
[junit4] 2> 754625 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[181]} 0 0
[junit4] 2> 754628 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[182]} 0 0
[junit4] 2> 754631 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[183]} 0 0
[junit4] 2> 754634 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[184]} 0 0
[junit4] 2> 754637 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[185]} 0 0
[junit4] 2> 754640 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[186]} 0 0
[junit4] 2> 754643 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[187]} 0 0
[junit4] 2> 754646 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[188]} 0 0
[junit4] 2> 754649 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[189]} 0 0
[junit4] 2> 754652 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[190]} 0 0
[junit4] 2> 754655 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[191]} 0 0
[junit4] 2> 754658 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[192]} 0 0
[junit4] 2> 754661 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[193]} 0 0
[junit4] 2> 754664 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[194]} 0 0
[junit4] 2> 754667 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[195]} 0 0
[junit4] 2> 754670 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[196]} 0 0
[junit4] 2> 754673 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[197]} 0 0
[junit4] 2> 754676 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[198]} 0 0
[junit4] 2> 754679 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[199]} 0 0
[junit4] 2> 754682 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[200]} 0 0
[junit4] 2> 754685 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[201]} 0 0
[junit4] 2> 754688 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[202]} 0 0
[junit4] 2> 754691 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[203]} 0 0
[junit4] 2> 754694 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[204]} 0 0
[junit4] 2> 754697 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[205]} 0 0
[junit4] 2> 754700 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[206]} 0 0
[junit4] 2> 754703 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[207]} 0 0
[junit4] 2> 754706 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[208]} 0 0
[junit4] 2> 754709 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[209]} 0 0
[junit4] 2> 754712 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[210]} 0 0
[junit4] 2> 754715 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[211]} 0 0
[junit4] 2> 754718 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[212]} 0 0
[junit4] 2> 754721 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[213]} 0 0
[junit4] 2> 754724 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[214]} 0 0
[junit4] 2> 754727 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[215]} 0 0
[junit4] 2> 754730 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[216]} 0 0
[junit4] 2> 754733 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[217]} 0 0
[junit4] 2> 754736 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[218]} 0 0
[junit4] 2> 754739 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[219]} 0 0
[junit4] 2> 754742 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[220]} 0 0
[junit4] 2> 754745 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[221]} 0 0
[junit4] 2> 754748 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[222]} 0 0
[junit4] 2> 754751 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[223]} 0 0
[junit4] 2> 754754 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[224]} 0 0
[junit4] 2> 754757 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[225]} 0 0
[junit4] 2> 754760 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[226]} 0 0
[junit4] 2> 754763 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[227]} 0 0
[junit4] 2> 754766 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[228]} 0 0
[junit4] 2> 754769 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[229]} 0 0
[junit4] 2> 754772 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[230]} 0 0
[junit4] 2> 754775 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[231]} 0 0
[junit4] 2> 754778 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[232]} 0 0
[junit4] 2> 754781 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[233]} 0 0
[junit4] 2> 754784 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[234]} 0 0
[junit4] 2> 754787 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[235]} 0 0
[junit4] 2> 754790 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[236]} 0 0
[junit4] 2> 754793 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[237]} 0 0
[junit4] 2> 754796 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[238]} 0 0
[junit4] 2> 754799 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[239]} 0 0
[junit4] 2> 754802 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[240]} 0 0
[junit4] 2> 754805 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[241]} 0 0
[junit4] 2> 754808 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[242]} 0 0
[junit4] 2> 754811 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[243]} 0 0
[junit4] 2> 754814 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[244]} 0 0
[junit4] 2> 754817 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[245]} 0 0
[junit4] 2> 754820 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[246]} 0 0
[junit4] 2> 754823 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[247]} 0 0
[junit4] 2> 754826 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[248]} 0 0
[junit4] 2> 754829 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[249]} 0 0
[junit4] 2> 754832 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[250]} 0 0
[junit4] 2> 754835 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[251]} 0 0
[junit4] 2> 754838 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[252]} 0 0
[junit4] 2> 754841 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[253]} 0 0
[junit4] 2> 754844 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[254]} 0 0
[junit4] 2> 754848 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[255]} 0 1
[junit4] 2> 754850 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[256]} 0 0
[junit4] 2> 754853 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[257]} 0 0
[junit4] 2> 754856 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[258]} 0 0
[junit4] 2> 754859 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[259]} 0 0
[junit4] 2> 754862 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[260]} 0 0
[junit4] 2> 754865 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[261]} 0 0
[junit4] 2> 754868 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[262]} 0 0
[junit4] 2> 754871 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[263]} 0 0
[junit4] 2> 754874 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[264]} 0 0
[junit4] 2> 754877 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[265]} 0 0
[junit4] 2> 754880 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[266]} 0 0
[junit4] 2> 754883 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[267]} 0 0
[junit4] 2> 754886 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[268]} 0 0
[junit4] 2> 754889 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[269]} 0 0
[junit4] 2> 754892 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[270]} 0 0
[junit4] 2> 754895 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[271]} 0 0
[junit4] 2> 754898 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[272]} 0 0
[junit4] 2> 754901 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[273]} 0 0
[junit4] 2> 754904 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[274]} 0 0
[junit4] 2> 754907 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[275]} 0 0
[junit4] 2> 754910 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[276]} 0 0
[junit4] 2> 754913 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[277]} 0 0
[junit4] 2> 754916 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[278]} 0 0
[junit4] 2> 754919 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[279]} 0 0
[junit4] 2> 754922 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[280]} 0 0
[junit4] 2> 754925 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[281]} 0 0
[junit4] 2> 754928 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[282]} 0 0
[junit4] 2> 754931 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[283]} 0 0
[junit4] 2> 754934 T4827 C551 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={qt=/replication&version=2&wt=javabin&command=indexversion} status=0 QTime=0
[junit4] 2> 754935 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[284]} 0 0
[junit4] 2> 754938 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[285]} 0 0
[junit4] 2> 754941 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[286]} 0 0
[junit4] 2> 754944 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[287]} 0 0
[junit4] 2> 754947 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[288]} 0 0
[junit4] 2> 754950 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[289]} 0 0
[junit4] 2> 754953 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[290]} 0 0
[junit4] 2> 754956 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[291]} 0 0
[junit4] 2> 754959 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[292]} 0 0
[junit4] 2> 754962 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[293]} 0 0
[junit4] 2> 754965 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[294]} 0 0
[junit4] 2> 754968 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[295]} 0 0
[junit4] 2> 754971 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[296]} 0 0
[junit4] 2> 754974 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[297]} 0 0
[junit4] 2> 754977 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[298]} 0 0
[junit4] 2> 754980 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[299]} 0 0
[junit4] 2> 754983 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[300]} 0 0
[junit4] 2> 754986 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[301]} 0 0
[junit4] 2> 754989 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[302]} 0 0
[junit4] 2> 754992 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[303]} 0 0
[junit4] 2> 754995 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[304]} 0 0
[junit4] 2> 754998 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[305]} 0 0
[junit4] 2> 755001 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[306]} 0 0
[junit4] 2> 755004 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[307]} 0 0
[junit4] 2> 755007 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[308]} 0 0
[junit4] 2> 755010 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[309]} 0 0
[junit4] 2> 755013 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[310]} 0 0
[junit4] 2> 755016 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[311]} 0 0
[junit4] 2> 755019 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[312]} 0 0
[junit4] 2> 755022 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[313]} 0 0
[junit4] 2> 755025 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[314]} 0 0
[junit4] 2> 755028 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[315]} 0 0
[junit4] 2> 755031 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[316]} 0 0
[junit4] 2> 755034 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[317]} 0 0
[junit4] 2> 755037 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[318]} 0 0
[junit4] 2> 755040 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[319]} 0 0
[junit4] 2> 755043 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[320]} 0 0
[junit4] 2> 755046 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[321]} 0 0
[junit4] 2> 755049 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[322]} 0 0
[junit4] 2> 755052 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[323]} 0 0
[junit4] 2> 755055 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[324]} 0 0
[junit4] 2> 755058 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[325]} 0 0
[junit4] 2> 755061 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[326]} 0 0
[junit4] 2> 755064 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[327]} 0 0
[junit4] 2> 755067 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[328]} 0 0
[junit4] 2> 755070 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[329]} 0 0
[junit4] 2> 755073 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[330]} 0 0
[junit4] 2> 755076 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[331]} 0 0
[junit4] 2> 755079 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[332]} 0 0
[junit4] 2> 755082 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[333]} 0 0
[junit4] 2> 755085 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[334]} 0 0
[junit4] 2> 755088 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[335]} 0 0
[junit4] 2> 755091 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[336]} 0 0
[junit4] 2> 755094 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[337]} 0 0
[junit4] 2> 755097 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[338]} 0 0
[junit4] 2> 755100 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[339]} 0 0
[junit4] 2> 755103 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[340]} 0 0
[junit4] 2> 755106 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[341]} 0 0
[junit4] 2> 755109 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[342]} 0 0
[junit4] 2> 755112 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[343]} 0 0
[junit4] 2> 755115 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[344]} 0 0
[junit4] 2> 755118 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[345]} 0 0
[junit4] 2> 755121 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[346]} 0 0
[junit4] 2> 755124 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[347]} 0 0
[junit4] 2> 755127 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[348]} 0 0
[junit4] 2> 755130 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[349]} 0 0
[junit4] 2> 755133 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[350]} 0 0
[junit4] 2> 755136 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[351]} 0 0
[junit4] 2> 755139 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[352]} 0 0
[junit4] 2> 755142 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[353]} 0 0
[junit4] 2> 755145 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[354]} 0 0
[junit4] 2> 755148 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[355]} 0 0
[junit4] 2> 755151 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[356]} 0 0
[junit4] 2> 755154 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[357]} 0 0
[junit4] 2> 755157 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[358]} 0 0
[junit4] 2> 755160 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[359]} 0 0
[junit4] 2> 755163 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[360]} 0 0
[junit4] 2> 755166 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[361]} 0 0
[junit4] 2> 755169 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[362]} 0 0
[junit4] 2> 755172 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[363]} 0 0
[junit4] 2> 755175 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[364]} 0 0
[junit4] 2> 755178 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[365]} 0 0
[junit4] 2> 755181 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[366]} 0 0
[junit4] 2> 755184 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[367]} 0 0
[junit4] 2> 755187 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[368]} 0 0
[junit4] 2> 755190 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[369]} 0 0
[junit4] 2> 755193 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[370]} 0 0
[junit4] 2> 755196 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[371]} 0 0
[junit4] 2> 755199 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[372]} 0 0
[junit4] 2> 755202 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[373]} 0 0
[junit4] 2> 755205 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[374]} 0 0
[junit4] 2> 755208 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[375]} 0 0
[junit4] 2> 755211 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[376]} 0 0
[junit4] 2> 755214 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[377]} 0 0
[junit4] 2> 755217 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[378]} 0 0
[junit4] 2> 755220 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[379]} 0 0
[junit4] 2> 755223 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[380]} 0 0
[junit4] 2> 755226 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[381]} 0 0
[junit4] 2> 755229 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[382]} 0 0
[junit4] 2> 755233 T4826 C551 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/
[...truncated too long message...]
41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 6parent_f2_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 3grand1_s=MockFixedIntBlock(blockSize=534), 1parent_f2_s=MockFixedIntBlock(blockSize=534), 5child0_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 24parent_f1_s=PostingsFormat(name=FSTPulsing41), 16parent_f2_s=MockFixedIntBlock(blockSize=534), 23parent_f1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 35parent_f1_s=PostingsFormat(name=FSTPulsing41), text_t=PostingsFormat(name=FSTPulsing41), 9grand8_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 5child1_s=PostingsFormat(name=FSTPulsing41), 17parent_f2_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 4child0_s=MockFixedIntBlock(blockSize=534), 10parent_f1_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 11parent_f1_s=MockFixedIntBlock(blockSize=534), 36parent_f1_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 37parent_f1_s=MockFixedIntBlock(blockSize=534), 3parent_f1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 49parent_f2_s=MockFixedIntBlock(blockSize=534), 46parent_f2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 33parent_f1_s=MockFixedIntBlock(blockSize=534), 8parent_f2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 3child1_s=MockFixedIntBlock(blockSize=534), 17parent_f1_s=PostingsFormat(name=FSTPulsing41), 9grand0_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 7grand2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 21parent_f2_s=PostingsFormat(name=FSTPulsing41), type_s=PostingsFormat(name=FSTPulsing41), 40parent_f2_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 5child3_s=MockFixedIntBlock(blockSize=534), 5grand3_s=MockFixedIntBlock(blockSize=534), _version_=PostingsFormat(name=FSTPulsing41), 5parent_f1_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 8grand6_s=PostingsFormat(name=FSTPulsing41), 7grand5_s=MockFixedIntBlock(blockSize=534), 24parent_f2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 4grand3_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 1grand0_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 7grand0_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 18parent_f1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 3parent_f2_s=PostingsFormat(name=FSTPulsing41), 15parent_f2_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 37parent_f2_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 4child1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 3child2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 22parent_f2_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 9grand3_s=MockFixedIntBlock(blockSize=534), 46parent_f1_s=PostingsFormat(name=FSTPulsing41), 7parent_f1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 6grand3_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 25parent_f1_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 4parent_f1_s=MockFixedIntBlock(blockSize=534), 38parent_f1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 42parent_f2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 21parent_f1_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 40parent_f1_s=MockFixedIntBlock(blockSize=534), 8grand1_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 5grand4_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 35parent_f2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 43parent_f2_s=PostingsFormat(name=FSTPulsing41), 47parent_f2_s=PostingsFormat(name=FSTPulsing41), 8grand0_s=MockFixedIntBlock(blockSize=534), 7grand1_s=MockFixedIntBlock(blockSize=534), 13parent_f2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 14parent_f1_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), a_t=PostingsFormat(name=FSTPulsing41), 1child0_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), rnd_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), 8grand3_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 30parent_f2_s=MockFixedIntBlock(blockSize=534), 3grand0_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 6grand1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 4parent_f2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 26parent_f1_s=MockFixedIntBlock(blockSize=534), 22parent_f1_s=MockFixedIntBlock(blockSize=534), 4child3_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 2parent_f1_s=PostingsFormat(name=FSTPulsing41), 2child0_s=PostingsFormat(name=FSTPulsing41), 48parent_f2_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 19parent_f1_s=MockFixedIntBlock(blockSize=534), 13parent_f1_s=PostingsFormat(name=FSTPulsing41), 30parent_f1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 31parent_f2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 27parent_f1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 31parent_f1_s=PostingsFormat(name=FSTPulsing41), 10parent_f2_s=PostingsFormat(name=FSTPulsing41), 25parent_f2_s=PostingsFormat(name=FSTPulsing41), 3grand2_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 12parent_f1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 2child1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 9grand4_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 4child2_s=PostingsFormat(name=FSTPulsing41), 26parent_f2_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 14parent_f2_s=PostingsFormat(name=FSTPulsing41), 34parent_f2_s=MockFixedIntBlock(blockSize=534), 45parent_f1_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), 8grand2_s=PostingsFormat(name=FSTPulsing41), 9parent_f1_s=Pulsing41(freqCutoff=11 minBlockSize=81 maxBlockSize=182), 7grand6_s=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=sr_RS, timezone=Asia/Ulan_Bator
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=161067976,total=441253888
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrXmlPersistence, TestSolrQueryParserDefaultOperatorResource, TestFoldingMultitermQuery, TimeZoneUtilsTest, TestSolrXml, HdfsUnloadDistributedZkTest, TestComponentsName, DistributedQueryComponentOptimizationTest, StatsComponentTest, EnumFieldTest, TestClassNameShortening, TestXIncludeConfig, DeleteReplicaTest, LeaderElectionIntegrationTest, XmlUpdateRequestHandlerTest, TestAnalyzeInfixSuggestions, TestIndexSearcher, TestBinaryResponseWriter, AsyncMigrateRouteKeyTest, TestSchemaResource, DisMaxRequestHandlerTest, TestNRTOpen, DirectUpdateHandlerTest, MinimalSchemaTest, MultiTermTest, HdfsLockFactoryTest, ConvertedLegacyTest, TestDFRSimilarityFactory, FileUtilsTest, DirectSolrSpellCheckerTest, PrimUtilsTest, HdfsChaosMonkeySafeLeaderTest, TestSerializedLuceneMatchVersion, TestReload, XsltUpdateRequestHandlerTest, FieldAnalysisRequestHandlerTest, HdfsSyncSliceTest, UniqFieldsUpdateProcessorFactoryTest, TestExceedMaxTermLength, TestOverriddenPrefixQueryForCustomFieldType, DocValuesMultiTest, TestCoreDiscovery, TestRecovery, BasicZkTest, TestDynamicFieldResource, ChaosMonkeyNothingIsSafeTest, TestSolrDeletionPolicy2, TestSolrCoreProperties, SolrCmdDistributorTest, BlockCacheTest, TestIndexingPerformance, TestJmxIntegration, TestWordDelimiterFilterFactory, DateFieldTest, PathHierarchyTokenizerFactoryTest, PingRequestHandlerTest, TestLazyCores, ChaosMonkeySafeLeaderTest, DistributedDebugComponentTest, HighlighterTest, TestCollapseQParserPlugin, TestSchemaNameResource, SpellCheckCollatorTest, DistanceFunctionTest, TestUtils, SignatureUpdateProcessorFactoryTest, InfoHandlerTest, TestDynamicFieldCollectionResource, TestStandardQParsers, BlockDirectoryTest, SimplePostToolTest, TestFreeTextSuggestions, SpellCheckComponentTest, TestSolrQueryParserResource, RemoteQueryErrorTest, HardAutoCommitTest, CollectionsAPIDistributedZkTest, SolrRequestParserTest, DefaultValueUpdateProcessorTest, TestFuzzyAnalyzedSuggestions, TestExpandComponent, TestDistributedMissingSort, TestPhraseSuggestions, TestHashPartitioner, TestFastOutputStream, NumericFieldsTest, ShardRoutingCustomTest, PreAnalyzedFieldTest, TestSolrXmlPersistor, TestQueryTypes, SpellingQueryConverterTest, TestNumberUtils, BasicDistributedZkTest, SyncSliceTest, FullSolrCloudDistribCmdsTest]
[junit4] Completed on J1 in 119.78s, 1 test, 1 error <<< FAILURES!
[...truncated 602 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:474: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/common-build.xml:490: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1276: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:908: There were test failures: 377 suites, 1597 tests, 1 error, 1 failure, 35 ignored (7 assumptions)
Total time: 201 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 542 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/542/
2 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch
Error Message:
Error executing query
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Error executing query
at __randomizedtesting.SeedInfo.seed([A9C01DD15A763399:282693C92D2953A5]:0)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:100)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.compareResults(AbstractFullDistribZkTestBase.java:1340)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.compareResults(AbstractFullDistribZkTestBase.java:1292)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:415)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:145)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.http.ParseException: Invalid content type:
at org.apache.http.entity.ContentType.parse(ContentType.java:233)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:450)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:203)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
... 45 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
Error Message:
ERROR: SolrIndexSearcher opens=120 closes=121
Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=120 closes=121
at __randomizedtesting.SeedInfo.seed([A9C01DD15A763399]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:405)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:176)
at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:789)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 10772 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> 2232928 T6201 oas.SolrTestCaseJ4.startTrackingSearchers WARN startTrackingSearchers: numOpens=6 numCloses=5
[junit4] 2> 2232929 T6201 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 2232938 T6201 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./solrtest-FullSolrCloudDistribCmdsTest-1395381157906
[junit4] 2> 2232940 T6201 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2232940 T6202 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2233041 T6201 oasc.ZkTestServer.run start zk server on port:61954
[junit4] 2> 2233042 T6201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2233046 T6208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1acfdfbf name:ZooKeeperConnection Watcher:127.0.0.1:61954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2233047 T6201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2233047 T6201 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2233058 T6201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2233060 T6210 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c146ea9 name:ZooKeeperConnection Watcher:127.0.0.1:61954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2233060 T6201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2233061 T6201 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2233064 T6201 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2233074 T6201 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2233076 T6201 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2233078 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2233079 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2233084 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 2233085 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2233088 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2233089 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2233091 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2233092 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2233102 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2233103 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2233105 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2233106 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2233108 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2233109 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2233111 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2233112 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2233115 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2233115 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2233123 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2233123 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2233126 T6201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2233126 T6201 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2234065 T6171 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2234096 T6201 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2234103 T6201 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:18662
[junit4] 2> 2234103 T6201 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2234103 T6201 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2234104 T6201 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097
[junit4] 2> 2234104 T6201 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097/'
[junit4] 2> 2234131 T6201 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097/solr.xml
[junit4] 2> 2234207 T6201 oasc.CoreContainer.<init> New CoreContainer 347650790
[junit4] 2> 2234207 T6201 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097/]
[junit4] 2> 2234208 T6201 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2234209 T6201 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2234209 T6201 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2234209 T6201 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2234209 T6201 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2234210 T6201 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2234210 T6201 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2234210 T6201 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2234211 T6201 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2234211 T6201 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2234211 T6201 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2234212 T6201 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2234212 T6201 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:61954/solr
[junit4] 2> 2234212 T6201 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2234213 T6201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2234215 T6221 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6bf65caa name:ZooKeeperConnection Watcher:127.0.0.1:61954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2234216 T6201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2234219 T6201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2234227 T6223 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5436c04d name:ZooKeeperConnection Watcher:127.0.0.1:61954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2234227 T6201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2234229 T6201 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2234231 T6201 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2234242 T6201 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2234245 T6201 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2234248 T6201 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2234251 T6201 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2234252 T6201 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18662_
[junit4] 2> 2234253 T6201 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18662_
[junit4] 2> 2234266 T6105 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2234266 T6105 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2234266 T6105 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2234266 T6105 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2234266 T6105 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2234270 T6201 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2234272 T6201 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2234282 T6201 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:18662_
[junit4] 2> 2234282 T6201 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2234285 T6201 oasc.Overseer.start Overseer (id=91447699564986371-127.0.0.1:18662_-n_0000000000) starting
[junit4] 2> 2234294 T6201 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2234317 T6225 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2234317 T6201 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2234318 T6225 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2234321 T6201 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2234322 T6201 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2234324 T6224 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2234330 T6226 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 2234331 T6226 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2234331 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2234332 T6226 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2234332 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2234333 T6224 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:18662",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:18662_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2234333 T6224 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 2234333 T6224 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2234335 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2234336 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> ASYNC NEW_CORE C8504 name=testSolrCloudCollection_shard2_replica2 org.apache.solr.core.SolrCore@6cdeaf5a url=http://127.0.0.1:23669/solr/testSolrCloudCollection_shard2_replica2 node=127.0.0.1:23669_solr C8504_STATE=coll:testSolrCloudCollection core:testSolrCloudCollection_shard2_replica2 props:{state=active, base_url=http://127.0.0.1:23669/solr, core=testSolrCloudCollection_shard2_replica2, node_name=127.0.0.1:23669_solr}
[junit4] 2> 2235150 T6137 C8504 P23669 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 2235151 T6137 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2235152 T6137 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:23669/solr/testSolrCloudCollection_shard2_replica2/ shard2
[junit4] 2> 2235152 T6137 oasc.SolrCore.close [testSolrCloudCollection_shard2_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@6cdeaf5a
[junit4] 2> 2235158 T6137 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 2235159 T6137 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2235159 T6137 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2235160 T6137 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2235161 T6137 oasc.SolrCore.closeSearcher [testSolrCloudCollection_shard2_replica2] Closing main searcher on request.
[junit4] 2> 2235161 T6137 oasc.CachingDirectoryFactory.close Closing RAMDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2235161 T6137 oasc.CachingDirectoryFactory.closeCacheValue looking to close data [CachedDir<<refCount=0;path=data;done=false>>]
[junit4] 2> 2235161 T6137 oasc.CachingDirectoryFactory.close Closing directory: data
[junit4] 2> 2235162 T6137 oasc.CachingDirectoryFactory.closeCacheValue looking to close data/index [CachedDir<<refCount=0;path=data/index;done=false>>]
[junit4] 2> 2235162 T6137 oasc.CachingDirectoryFactory.close Closing directory: data/index
[junit4] 2> 2235162 T6137 oascc.SolrZkClient.makePath makePath: /collections/testSolrCloudCollection/leaders/shard2
[junit4] 2> 2235163 T6137 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:297)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
[junit4] 2> ... 7 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:385)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:372)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
[junit4] 2> ... 8 more
[junit4] 2>
[junit4] 2> 2235164 T6137 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testSolrCloudCollection/leader_elect/shard2/election/91447698658361356-core_node4-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:176)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:71)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:317)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2235164 T6137 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2235334 T6226 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2235334 T6226 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097/collection1
[junit4] 2> 2235334 T6226 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2235335 T6226 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2235335 T6226 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2235336 T6226 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2235336 T6226 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097/collection1/'
[junit4] 2> 2235338 T6226 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097/collection1/lib/README' to classloader
[junit4] 2> 2235339 T6226 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097/collection1/lib/.svn/' to classloader
[junit4] 2> 2235340 T6226 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097/collection1/lib/classes/' to classloader
[junit4] 2> 2235411 T6226 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 2235480 T6226 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2235482 T6226 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2235491 T6226 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2236082 T6226 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2236087 T6226 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2236089 T6226 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2236094 T6226 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2236111 T6226 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2236112 T6226 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1395381158097/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/control/data/
[junit4] 2> 2236112 T6226 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@68dc2bbe
[junit4] 2> 2236113 T6226 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/control/data
[junit4] 2> 2236113 T6226 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/control/data/index/
[junit4] 2> 2236113 T6226 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 2236114 T6226 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/control/data/index
[junit4] 2> 2236114 T6226 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2236115 T6226 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@23f6734e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@594e9681),segFN=segments_1,generation=1}
[junit4] 2> 2236115 T6226 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2236118 T6226 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2236119 T6226 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2236119 T6226 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2236119 T6226 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2236120 T6226 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2236120 T6226 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2236121 T6226 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2236121 T6226 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2236121 T6226 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2236122 T6226 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2236123 T6226 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2236123 T6226 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2236123 T6226 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2236124 T6226 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2236124 T6226 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2236124 T6226 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2236142 T6226 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2236149 T6226 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2236149 T6226 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2236150 T6226 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=74.01171875, floorSegmentMB=1.3984375, forceMergeDeletesPctAllowed=24.091022188686505, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2236151 T6226 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@23f6734e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@594e9681),segFN=segments_1,generation=1}
[junit4] 2> 2236151 T6226 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2236151 T6226 oass.SolrIndexSearcher.<init> Opening Searcher@a1abfaf[collection1] main
[junit4] 2> 2236154 T6227 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a1abfaf[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2236156 T6226 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2236156 T6201 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1
[junit4] 2> 2236157 T6201 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2236156 T6230 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18662 collection:control_collection shard:shard1
[junit4] 2> 2236158 T6201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2236158 T6230 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2236182 T6232 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bd2429e name:ZooKeeperConnection Watcher:127.0.0.1:61954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2236182 T6201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2236185 T6201 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2236205 T6201 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2236227 T6230 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2236230 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2236231 T6230 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2236231 T6230 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C8505 name=collection1 org.apache.solr.core.SolrCore@1a023273 url=http://127.0.0.1:18662/collection1 node=127.0.0.1:18662_ C8505_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:18662, core=collection1, node_name=127.0.0.1:18662_}
[junit4] 2> 2236231 T6230 C8505 P18662 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:18662/collection1/
[junit4] 2> 2236231 T6230 C8505 P18662 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2236232 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2236232 T6230 C8505 P18662 oasc.SyncStrategy.syncToMe http://127.0.0.1:18662/collection1/ has no replicas
[junit4] 2> 2236232 T6230 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:18662/collection1/ shard1
[junit4] 2> 2236232 T6230 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2236248 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2236258 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2236258 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2236262 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2236265 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2236368 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2236368 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2236415 T6230 oasc.ZkController.register We are http://127.0.0.1:18662/collection1/ and leader is http://127.0.0.1:18662/collection1/
[junit4] 2> 2236415 T6230 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18662
[junit4] 2> 2236415 T6230 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2236415 T6230 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 2236416 T6230 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2236417 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2236417 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2236417 T6230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2236417 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2236418 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2236419 T6224 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:18662",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:18662_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 2236428 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2236534 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2236534 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2237163 T6201 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 2237164 T6201 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2237167 T6201 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:64255
[junit4] 2> 2237167 T6201 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2237167 T6201 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2237168 T6201 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173
[junit4] 2> 2237168 T6201 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173/'
[junit4] 2> 2237195 T6201 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173/solr.xml
[junit4] 2> 2237260 T6201 oasc.CoreContainer.<init> New CoreContainer 824397250
[junit4] 2> 2237261 T6201 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173/]
[junit4] 2> 2237262 T6201 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2237262 T6201 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2237262 T6201 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2237263 T6201 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2237263 T6201 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2237263 T6201 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2237263 T6201 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2237264 T6201 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2237264 T6201 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2237265 T6201 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2237265 T6201 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2237265 T6201 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2237265 T6201 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:61954/solr
[junit4] 2> 2237266 T6201 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2237267 T6201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2237295 T6243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c614c2 name:ZooKeeperConnection Watcher:127.0.0.1:61954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2237296 T6201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2237300 T6201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2237301 T6245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74a2893e name:ZooKeeperConnection Watcher:127.0.0.1:61954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2237302 T6201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2237328 T6201 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2238331 T6201 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64255_
[junit4] 2> 2238333 T6201 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64255_
[junit4] 2> 2238336 T6223 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2238336 T6232 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2238337 T6245 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2238344 T6246 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2238344 T6246 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2238345 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2238346 T6246 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2238346 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2238346 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2238347 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2238347 T6224 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:64255",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64255_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2238348 T6224 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 2238348 T6224 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2238357 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2238358 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2238358 T6245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2238358 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2239347 T6246 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2239347 T6246 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173/collection1
[junit4] 2> 2239347 T6246 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2239348 T6246 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2239348 T6246 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2239349 T6246 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2239350 T6246 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173/collection1/'
[junit4] 2> 2239352 T6246 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173/collection1/lib/classes/' to classloader
[junit4] 2> 2239354 T6246 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173/collection1/lib/README' to classloader
[junit4] 2> 2239355 T6246 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173/collection1/lib/.svn/' to classloader
[junit4] 2> 2239443 T6246 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 2239527 T6246 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2239528 T6246 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2239538 T6246 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2240121 T6246 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2240125 T6246 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2240127 T6246 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2240132 T6246 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2240149 T6246 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2240150 T6246 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1395381161173/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty1/
[junit4] 2> 2240150 T6246 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@68dc2bbe
[junit4] 2> 2240151 T6246 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty1
[junit4] 2> 2240151 T6246 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty1/index/
[junit4] 2> 2240152 T6246 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 2240152 T6246 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty1/index
[junit4] 2> 2240152 T6246 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2240153 T6246 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1e9fa7c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63b6de12),segFN=segments_1,generation=1}
[junit4] 2> 2240154 T6246 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2240157 T6246 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2240158 T6246 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2240158 T6246 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2240158 T6246 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2240159 T6246 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2240159 T6246 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2240159 T6246 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2240160 T6246 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2240160 T6246 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2240161 T6246 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2240161 T6246 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2240161 T6246 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2240162 T6246 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2240162 T6246 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2240163 T6246 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2240163 T6246 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2240181 T6246 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2240187 T6246 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2240187 T6246 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2240188 T6246 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=74.01171875, floorSegmentMB=1.3984375, forceMergeDeletesPctAllowed=24.091022188686505, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2240188 T6246 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1e9fa7c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63b6de12),segFN=segments_1,generation=1}
[junit4] 2> 2240189 T6246 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2240189 T6246 oass.SolrIndexSearcher.<init> Opening Searcher@2803d3e7[collection1] main
[junit4] 2> 2240193 T6247 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2803d3e7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2240195 T6246 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2240196 T6201 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1
[junit4] 2> 2240197 T6201 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2240196 T6250 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64255 collection:collection1 shard:shard2
[junit4] 2> 2240198 T6250 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2240219 T6250 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2240221 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2240222 T6250 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2240222 T6250 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C8506 name=collection1 org.apache.solr.core.SolrCore@794acb98 url=http://127.0.0.1:64255/collection1 node=127.0.0.1:64255_ C8506_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:64255, core=collection1, node_name=127.0.0.1:64255_}
[junit4] 2> 2240222 T6250 C8506 P64255 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:64255/collection1/
[junit4] 2> 2240222 T6250 C8506 P64255 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2240222 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2240223 T6250 C8506 P64255 oasc.SyncStrategy.syncToMe http://127.0.0.1:64255/collection1/ has no replicas
[junit4] 2> 2240223 T6250 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:64255/collection1/ shard2
[junit4] 2> 2240223 T6250 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2240225 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2240226 T6245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2240226 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2240226 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2240229 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2240231 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2240334 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2240335 T6245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2240334 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2240382 T6250 oasc.ZkController.register We are http://127.0.0.1:64255/collection1/ and leader is http://127.0.0.1:64255/collection1/
[junit4] 2> 2240382 T6250 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64255
[junit4] 2> 2240383 T6250 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2240383 T6250 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2240383 T6250 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2240384 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2240385 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2240385 T6250 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2240385 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2240386 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2240387 T6224 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:64255",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64255_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 2240389 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2240491 T6245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2240491 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2240491 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2241143 T6201 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 2241144 T6201 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2241147 T6201 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53531
[junit4] 2> 2241147 T6201 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2241148 T6201 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2241148 T6201 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165
[junit4] 2> 2241148 T6201 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165/'
[junit4] 2> 2241175 T6201 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165/solr.xml
[junit4] 2> 2241239 T6201 oasc.CoreContainer.<init> New CoreContainer 211056674
[junit4] 2> 2241239 T6201 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165/]
[junit4] 2> 2241240 T6201 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2241241 T6201 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2241241 T6201 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2241241 T6201 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2241242 T6201 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2241242 T6201 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2241242 T6201 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2241242 T6201 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2241243 T6201 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2241243 T6201 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2241244 T6201 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2241244 T6201 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2241244 T6201 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:61954/solr
[junit4] 2> 2241245 T6201 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2241245 T6201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2241248 T6261 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@675b06a1 name:ZooKeeperConnection Watcher:127.0.0.1:61954 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2241249 T6201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2241251 T6201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2241268 T6263 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@708653b0 name:ZooKeeperConnection Watcher:127.0.0.1:61954/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2241268 T6201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2241285 T6201 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2242287 T6201 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53531_
[junit4] 2> 2242315 T6201 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53531_
[junit4] 2> 2242319 T6245 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2242320 T6263 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2242320 T6223 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2242320 T6232 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2242328 T6264 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2242329 T6264 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2242330 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2242330 T6264 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2242331 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2242331 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2242332 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2242332 T6224 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53531",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53531_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2242333 T6224 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2242333 T6224 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2242336 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2242345 T6263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2242345 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2242345 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2242345 T6245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2243332 T6264 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2243332 T6264 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165/collection1
[junit4] 2> 2243332 T6264 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2243333 T6264 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2243333 T6264 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2243334 T6264 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2243334 T6264 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165/collection1/'
[junit4] 2> 2243336 T6264 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165/collection1/lib/README' to classloader
[junit4] 2> 2243336 T6264 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165/collection1/lib/.svn/' to classloader
[junit4] 2> 2243337 T6264 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165/collection1/lib/classes/' to classloader
[junit4] 2> 2243408 T6264 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 2243478 T6264 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2243479 T6264 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2243489 T6264 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2244066 T6264 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2244070 T6264 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2244072 T6264 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2244077 T6264 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2244095 T6264 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2244096 T6264 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1395381165165/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty2/
[junit4] 2> 2244096 T6264 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@68dc2bbe
[junit4] 2> 2244097 T6264 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty2
[junit4] 2> 2244097 T6264 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty2/index/
[junit4] 2> 2244098 T6264 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 2244099 T6264 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1395381157905/jetty2/index
[junit4] 2> 2244100 T6264 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2244101 T6264 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@404cbcbd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b8bca4d),segFN=segments_1,generation=1}
[junit4] 2> 2244101 T6264 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2244104 T6264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2244105 T6264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2244105 T6264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2244106 T6264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2244106 T6264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2244106 T6264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2244107 T6264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2244107 T6264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2244107 T6264 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2244108 T6264 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2244109 T6264 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2244109 T6264 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2244109 T6264 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2244110 T6264 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2244110 T6264 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2244111 T6264 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2244128 T6264 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2244144 T6264 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2244145 T6264 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2244145 T6264 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=74.01171875, floorSegmentMB=1.3984375, forceMergeDeletesPctAllowed=24.091022188686505, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2244146 T6264 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@404cbcbd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b8bca4d),segFN=segments_1,generation=1}
[junit4] 2> 2244146 T6264 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2244147 T6264 oass.SolrIndexSearcher.<init> Opening Searcher@28aeb62f[collection1] main
[junit4] 2> 2244150 T6265 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@28aeb62f[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2244153 T6264 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2244153 T6201 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1
[junit4] 2> 2244154 T6201 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2244153 T6268 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53531 collection:collection1 shard:shard1
[junit4] 2> 2244155 T6268 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2244170 T6268 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2244178 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2244178 T6268 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2244178 T6268 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C8507 name=collection1 org.apache.solr.core.SolrCore@6d04d984 url=http://127.0.0.1:53531/collection1 node=127.0.0.1:53531_ C8507_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:53531, core=collection1, node_name=127.0.0.1:53531_}
[junit4] 2> 2244179 T6268 C8507 P53531 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53531/collection1/
[junit4] 2> 2244179 T6268 C8507 P53531 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2244179 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2244179 T6268 C8507 P53531 oasc.SyncStrategy.syncToMe http://127.0.0.1:53531/collection1/ has no replicas
[junit4] 2> 2244180 T6268 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53531/collection1/ shard1
[junit4] 2> 2244180 T6268 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2244187 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2244188 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2244188 T6263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2244188 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2244188 T6245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2244201 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2244210 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2244313 T6223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2244313 T6245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2244313 T6263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2244313 T6232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2244353 T6268 oasc.ZkController.register We are http://127.0.0.1:53531/collection1/ and leader is http://127.0.0.1:53531/collection1/
[junit4] 2> 2244353 T6268 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53531
[junit4] 2> 2244353 T6268 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2244353 T6268 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2244354 T6268 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2244356 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2244356 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2244356 T6268 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2244356 T6223 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2244357 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2244358 T6224 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:53531",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53531_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"colle
[...truncated too long message...]
2> 2382265 T6338 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty6-1395381181152/collection2_shard3_replica3/data [CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty6-1395381181152/collection2_shard3_replica3/data;done=false>>]
[junit4] 2> 2382265 T6338 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty6-1395381181152/collection2_shard3_replica3/data
[junit4] 2> 2382266 T6338 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty6-1395381181152/collection2_shard3_replica3/data/index [CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty6-1395381181152/collection2_shard3_replica3/data/index;done=false>>]
[junit4] 2> 2382266 T6338 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J1/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty6-1395381181152/collection2_shard3_replica3/data/index
[junit4] 2> 2382266 T6338 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2382266 T6338 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard2/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2382267 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2382267 T6338 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2382267 T6338 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2501819 T6201 oas.SolrTestCaseJ4.endTrackingSearchers ERROR ERROR: SolrIndexSearcher opens=120 closes=121
[junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ar_JO, timezone=Europe/Vilnius
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=192428200,total=477233152
[junit4] 2> NOTE: All tests run in this JVM: [TestCloudManagedSchema, ShardRoutingCustomTest, DistributedExpandComponentTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, TestClassNameShortening, OpenCloseCoreStressTest, XsltUpdateRequestHandlerTest, SpellCheckComponentTest, TestHashPartitioner, TestFoldingMultitermQuery, PrimUtilsTest, SolrRequestParserTest, TestJmxIntegration, NotRequiredUniqueKeyTest, SortByFunctionTest, DirectUpdateHandlerTest, DistributedDebugComponentTest, TestImplicitCoreProperties, TestCSVResponseWriter, TestFastLRUCache, TestStressReorder, TestCSVLoader, TestFiltering, DirectSolrSpellCheckerTest, TestDynamicFieldCollectionResource, TestQuerySenderNoQuery, HdfsChaosMonkeySafeLeaderTest, NoCacheHeaderTest, TestCoreDiscovery, SolrCoreCheckLockOnStartupTest, DistributedQueryComponentCustomSortTest, TestDistributedSearch, TestAnalyzedSuggestions, DisMaxRequestHandlerTest, TestLazyCores, TestFastWriter, TestXIncludeConfig, TestMaxScoreQueryParser, TestIBSimilarityFactory, MultiTermTest, TestCollationField, TestFastOutputStream, DebugComponentTest, SuggesterTSTTest, BasicZkTest, CoreContainerCoreInitFailuresTest, ZkSolrClientTest, IndexBasedSpellCheckerTest, TestFieldTypeResource, TestZkChroot, DefaultValueUpdateProcessorTest, OpenExchangeRatesOrgProviderTest, TestDFRSimilarityFactory, CachingDirectoryFactoryTest, HdfsUnloadDistributedZkTest, StandardRequestHandlerTest, TestFieldResource, AsyncMigrateRouteKeyTest, TestIndexingPerformance, HdfsDirectoryTest, LeaderElectionIntegrationTest, OutputWriterTest, ZkNodePropsTest, TestSolrQueryParserDefaultOperatorResource, TestUtils, RemoteQueryErrorTest, PreAnalyzedFieldTest, TestDefaultSimilarityFactory, DocumentAnalysisRequestHandlerTest, TestDistributedGrouping, TestRangeQuery, TestStandardQParsers, RequestHandlersTest, SolrCmdDistributorTest, TestWordDelimiterFilterFactory, RequiredFieldsTest, TestReload, TestRecoveryHdfs, TestBinaryResponseWriter, CoreAdminCreateDiscoverTest, DocValuesMultiTest, SuggesterWFSTTest, FullSolrCloudDistribCmdsTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.seed=A9C01DD15A763399 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=ar_JO -Dtests.timezone=Europe/Vilnius -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | FullSolrCloudDistribCmdsTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=120 closes=121
[junit4] > at __randomizedtesting.SeedInfo.seed([A9C01DD15A763399]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:405)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:176)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] Completed on J1 in 268.94s, 1 test, 1 failure, 1 error <<< FAILURES!
[...truncated 523 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:474: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/common-build.xml:490: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1276: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:908: There were test failures: 377 suites, 1597 tests, 1 suite-level error, 1 error, 35 ignored (7 assumptions)
Total time: 137 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 541 - Still Failing
Posted by Michael McCandless <lu...@mikemccandless.com>.
I committed a fix.
Mike McCandless
http://blog.mikemccandless.com
On Wed, Mar 19, 2014 at 6:33 PM, Apache Jenkins Server
<je...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/541/
>
> 1 tests failed.
> REGRESSION: org.apache.lucene.replicator.LocalReplicatorTest.testObtainMissingFile
>
> Error Message:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/replicator/test/J1/index3004630048tmp/madeUpFile
>
> Stack Trace:
> java.nio.file.NoSuchFileException: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/replicator/test/J1/index3004630048tmp/madeUpFile
> at __randomizedtesting.SeedInfo.seed([441C78757690D0BA:621FD230CEC36F9D]:0)
> at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
> at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
> at java.nio.channels.FileChannel.open(FileChannel.java:287)
> at java.nio.channels.FileChannel.open(FileChannel.java:334)
> at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:82)
> at org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80)
> at org.apache.lucene.replicator.IndexRevision.open(IndexRevision.java:136)
> at org.apache.lucene.replicator.LocalReplicator.obtainFile(LocalReplicator.java:198)
> at org.apache.lucene.replicator.LocalReplicatorTest.testObtainMissingFile(LocalReplicatorTest.java:155)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
> at java.lang.Thread.run(Thread.java:724)
>
>
>
>
> Build Log:
> [...truncated 9061 lines...]
> [junit4] Suite: org.apache.lucene.replicator.LocalReplicatorTest
> [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LocalReplicatorTest -Dtests.method=testObtainMissingFile -Dtests.seed=441C78757690D0BA -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=no_NO_NY -Dtests.timezone=SST -Dtests.file.encoding=UTF-8
> [junit4] ERROR 0.14s J1 | LocalReplicatorTest.testObtainMissingFile <<<
> [junit4] > Throwable #1: java.nio.file.NoSuchFileException: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/replicator/test/J1/index3004630048tmp/madeUpFile
> [junit4] > at __randomizedtesting.SeedInfo.seed([441C78757690D0BA:621FD230CEC36F9D]:0)
> [junit4] > at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
> [junit4] > at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
> [junit4] > at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
> [junit4] > at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
> [junit4] > at java.nio.channels.FileChannel.open(FileChannel.java:287)
> [junit4] > at java.nio.channels.FileChannel.open(FileChannel.java:334)
> [junit4] > at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:82)
> [junit4] > at org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80)
> [junit4] > at org.apache.lucene.replicator.IndexRevision.open(IndexRevision.java:136)
> [junit4] > at org.apache.lucene.replicator.LocalReplicator.obtainFile(LocalReplicator.java:198)
> [junit4] > at org.apache.lucene.replicator.LocalReplicatorTest.testObtainMissingFile(LocalReplicatorTest.java:155)
> [junit4] > at java.lang.Thread.run(Thread.java:724)
> [junit4] 2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=no_NO_NY, timezone=SST
> [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=143578584,total=195624960
> [junit4] 2> NOTE: All tests run in this JVM: [LocalReplicatorTest]
> [junit4] Completed on J1 in 2.37s, 10 tests, 1 error <<< FAILURES!
>
> [...truncated 28 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:474: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:447: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:45: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/extra-targets.xml:37: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build.xml:539: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1996: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/module-build.xml:60: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1276: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:908: There were test failures: 7 suites, 30 tests, 1 error
>
> Total time: 86 minutes 5 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-NightlyTests-4.x - Build # 541 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/541/
1 tests failed.
REGRESSION: org.apache.lucene.replicator.LocalReplicatorTest.testObtainMissingFile
Error Message:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/replicator/test/J1/index3004630048tmp/madeUpFile
Stack Trace:
java.nio.file.NoSuchFileException: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/replicator/test/J1/index3004630048tmp/madeUpFile
at __randomizedtesting.SeedInfo.seed([441C78757690D0BA:621FD230CEC36F9D]:0)
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:334)
at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:82)
at org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80)
at org.apache.lucene.replicator.IndexRevision.open(IndexRevision.java:136)
at org.apache.lucene.replicator.LocalReplicator.obtainFile(LocalReplicator.java:198)
at org.apache.lucene.replicator.LocalReplicatorTest.testObtainMissingFile(LocalReplicatorTest.java:155)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9061 lines...]
[junit4] Suite: org.apache.lucene.replicator.LocalReplicatorTest
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LocalReplicatorTest -Dtests.method=testObtainMissingFile -Dtests.seed=441C78757690D0BA -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=no_NO_NY -Dtests.timezone=SST -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.14s J1 | LocalReplicatorTest.testObtainMissingFile <<<
[junit4] > Throwable #1: java.nio.file.NoSuchFileException: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build/replicator/test/J1/index3004630048tmp/madeUpFile
[junit4] > at __randomizedtesting.SeedInfo.seed([441C78757690D0BA:621FD230CEC36F9D]:0)
[junit4] > at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
[junit4] > at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
[junit4] > at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
[junit4] > at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
[junit4] > at java.nio.channels.FileChannel.open(FileChannel.java:287)
[junit4] > at java.nio.channels.FileChannel.open(FileChannel.java:334)
[junit4] > at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:82)
[junit4] > at org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80)
[junit4] > at org.apache.lucene.replicator.IndexRevision.open(IndexRevision.java:136)
[junit4] > at org.apache.lucene.replicator.LocalReplicator.obtainFile(LocalReplicator.java:198)
[junit4] > at org.apache.lucene.replicator.LocalReplicatorTest.testObtainMissingFile(LocalReplicatorTest.java:155)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] 2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=no_NO_NY, timezone=SST
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=143578584,total=195624960
[junit4] 2> NOTE: All tests run in this JVM: [LocalReplicatorTest]
[junit4] Completed on J1 in 2.37s, 10 tests, 1 error <<< FAILURES!
[...truncated 28 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:474: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build.xml:539: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1996: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/module-build.xml:60: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1276: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:908: There were test failures: 7 suites, 30 tests, 1 error
Total time: 86 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure