You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/03/03 15:06:13 UTC
[JENKINS-EA] Lucene-Solr-6.4-Linux (32bit/jdk-9-ea+158) - Build #
126 - Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.4-Linux/126/
Java: 32bit/jdk-9-ea+158 -client -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=2007, name=SocketProxy-Response-32874:49790, state=RUNNABLE, group=TGRP-HttpPartitionTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=2007, name=SocketProxy-Response-32874:49790, state=RUNNABLE, group=TGRP-HttpPartitionTest]
at __randomizedtesting.SeedInfo.seed([2C617D978245810C:A435424D2CB9ECF4]:0)
Caused by: java.lang.RuntimeException: java.net.SocketException: Socket is closed
at __randomizedtesting.SeedInfo.seed([2C617D978245810C]:0)
at org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:347)
Caused by: java.net.SocketException: Socket is closed
at java.base/java.net.Socket.setSoTimeout(Socket.java:1137)
at org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:344)
Build Log:
[...truncated 11063 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/init-core-data-001
[junit4] 2> 155803 INFO (SUITE-HttpPartitionTest-seed#[2C617D978245810C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
[junit4] 2> 155803 INFO (SUITE-HttpPartitionTest-seed#[2C617D978245810C]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 155804 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 155804 INFO (Thread-336) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 155805 INFO (Thread-336) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 155905 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkTestServer start zk server on port:33001
[junit4] 2> 155911 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 155914 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 155916 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 155918 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 155920 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 155922 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 155924 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 155926 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 155928 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 155930 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 155932 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 156797 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores/collection1
[junit4] 2> 156800 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 156801 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@132d423{/,null,AVAILABLE}
[junit4] 2> 156805 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@562fa2{HTTP/1.1,[http/1.1]}{127.0.0.1:32874}
[junit4] 2> 156805 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.Server Started @158765ms
[junit4] 2> 156805 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/tempDir-001/control/data, hostPort=33520, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores}
[junit4] 2> 156805 ERROR (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 156805 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.2
[junit4] 2> 156805 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 156805 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 156805 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-03-03T14:24:08.647694Z
[junit4] 2> 156809 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 156809 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/solr.xml
[junit4] 2> 156819 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 156820 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33001/solr
[junit4] 2> 156838 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33520_
[junit4] 2> 156839 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.Overseer Overseer (id=97553681458790404-127.0.0.1:33520_-n_0000000000) starting
[junit4] 2> 156843 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33520_
[junit4] 2> 156844 INFO (zkCallback-316-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 156930 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores
[junit4] 2> 156930 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 156932 INFO (OverseerStateUpdate-97553681458790404-127.0.0.1:33520_-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 157945 WARN (coreLoadExecutor-607-thread-1) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 157946 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
[junit4] 2> 157962 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 158065 WARN (coreLoadExecutor-607-thread-1) [ ] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 158068 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 158080 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 158080 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/control-001/cores/collection1/data/]
[junit4] 2> 158081 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
[junit4] 2> 158082 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 158089 WARN (coreLoadExecutor-607-thread-1) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 158104 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 158104 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 158109 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 158110 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 158110 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 158110 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d9d011[collection1] main]
[junit4] 2> 158111 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 158111 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 158111 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 158113 INFO (searcherExecutor-608-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1d9d011[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 158113 INFO (coreLoadExecutor-607-thread-1) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560858905757614080
[junit4] 2> 158120 INFO (coreZkRegister-600-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 158120 INFO (coreZkRegister-600-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 158120 INFO (coreZkRegister-600-thread-1) [ ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33520/collection1/
[junit4] 2> 158120 INFO (coreZkRegister-600-thread-1) [ ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 158120 INFO (coreZkRegister-600-thread-1) [ ] o.a.s.c.SyncStrategy http://127.0.0.1:33520/collection1/ has no replicas
[junit4] 2> 158124 INFO (coreZkRegister-600-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33520/collection1/ shard1
[junit4] 2> 158275 INFO (coreZkRegister-600-thread-1) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 158521 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 158521 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33001/solr ready
[junit4] 2> 158521 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 158522 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 159567 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores/collection1
[junit4] 2> 159569 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001
[junit4] 2> 159570 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 159571 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@fc018b{/,null,AVAILABLE}
[junit4] 2> 159572 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1a5e1c4{HTTP/1.1,[http/1.1]}{127.0.0.1:38629}
[junit4] 2> 159572 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.Server Started @161532ms
[junit4] 2> 159572 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/tempDir-001/jetty1, hostPort=45697, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores}
[junit4] 2> 159572 ERROR (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 159572 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.2
[junit4] 2> 159572 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 159572 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 159572 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-03-03T14:24:11.414752Z
[junit4] 2> 159576 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 159576 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/solr.xml
[junit4] 2> 159583 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 159585 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33001/solr
[junit4] 2> 159592 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 159595 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45697_
[junit4] 2> 159596 INFO (zkCallback-320-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 159597 INFO (zkCallback-316-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 159601 INFO (zkCallback-326-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 159870 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores
[junit4] 2> 159870 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 159876 INFO (OverseerStateUpdate-97553681458790404-127.0.0.1:33520_-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 159988 INFO (zkCallback-326-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 160889 WARN (coreLoadExecutor-618-thread-1) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 160889 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
[junit4] 2> 160899 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 160957 WARN (coreLoadExecutor-618-thread-1) [ ] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 160959 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 160966 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 160966 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-1-001/cores/collection1/data/]
[junit4] 2> 160966 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
[junit4] 2> 160967 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 160972 WARN (coreLoadExecutor-618-thread-1) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 160982 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 160982 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 160985 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 160985 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 160986 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 160986 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@895702[collection1] main]
[junit4] 2> 160987 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 160987 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 160987 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 160989 INFO (searcherExecutor-619-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@895702[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 160990 INFO (coreLoadExecutor-618-thread-1) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560858908773318656
[junit4] 2> 160995 INFO (coreZkRegister-613-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 160995 INFO (coreZkRegister-613-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 160995 INFO (coreZkRegister-613-thread-1) [ ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45697/collection1/
[junit4] 2> 160995 INFO (coreZkRegister-613-thread-1) [ ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 160995 INFO (coreZkRegister-613-thread-1) [ ] o.a.s.c.SyncStrategy http://127.0.0.1:45697/collection1/ has no replicas
[junit4] 2> 160997 INFO (coreZkRegister-613-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45697/collection1/ shard2
[junit4] 2> 161099 INFO (zkCallback-326-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 161148 INFO (coreZkRegister-613-thread-1) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 161251 INFO (zkCallback-326-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 161824 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/collection1
[junit4] 2> 161825 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001
[junit4] 2> 161826 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 161827 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e15ac4{/,null,AVAILABLE}
[junit4] 2> 161827 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@8793ae{HTTP/1.1,[http/1.1]}{127.0.0.1:36026}
[junit4] 2> 161827 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.Server Started @163788ms
[junit4] 2> 161827 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/tempDir-001/jetty2, hostPort=46336, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores}
[junit4] 2> 161827 ERROR (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 161828 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.2
[junit4] 2> 161828 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 161828 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 161828 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-03-03T14:24:13.670183Z
[junit4] 2> 161831 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 161831 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/solr.xml
[junit4] 2> 161837 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 161839 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33001/solr
[junit4] 2> 161845 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 161847 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46336_
[junit4] 2> 161848 INFO (zkCallback-320-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 161848 INFO (zkCallback-316-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 161848 INFO (zkCallback-326-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 161848 INFO (zkCallback-332-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 161917 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores
[junit4] 2> 161917 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 161919 INFO (OverseerStateUpdate-97553681458790404-127.0.0.1:33520_-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 162020 INFO (zkCallback-326-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 162020 INFO (zkCallback-332-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 162926 WARN (coreLoadExecutor-629-thread-1) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 162927 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
[junit4] 2> 162940 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 162993 WARN (coreLoadExecutor-629-thread-1) [ ] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 162996 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 163002 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 163003 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/collection1/data/]
[junit4] 2> 163003 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
[junit4] 2> 163004 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 163009 WARN (coreLoadExecutor-629-thread-1) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 163021 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 163021 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 163024 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 163024 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 163025 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 163025 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@ce9655[collection1] main]
[junit4] 2> 163026 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 163026 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 163026 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 163027 INFO (searcherExecutor-630-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@ce9655[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 163027 INFO (coreLoadExecutor-629-thread-1) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560858910910316544
[junit4] 2> 163032 INFO (coreZkRegister-624-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 163032 INFO (coreZkRegister-624-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 163032 INFO (coreZkRegister-624-thread-1) [ ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46336/collection1/
[junit4] 2> 163032 INFO (coreZkRegister-624-thread-1) [ ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 163032 INFO (coreZkRegister-624-thread-1) [ ] o.a.s.c.SyncStrategy http://127.0.0.1:46336/collection1/ has no replicas
[junit4] 2> 163033 INFO (coreZkRegister-624-thread-1) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46336/collection1/ shard1
[junit4] 2> 163135 INFO (zkCallback-332-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 163135 INFO (zkCallback-326-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 163184 INFO (coreZkRegister-624-thread-1) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 163290 INFO (zkCallback-326-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 163290 INFO (zkCallback-332-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 164352 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/collection1
[junit4] 2> 164354 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001
[junit4] 2> 164354 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 164355 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e1ab35{/,null,AVAILABLE}
[junit4] 2> 164356 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7dc250{HTTP/1.1,[http/1.1]}{127.0.0.1:36998}
[junit4] 2> 164356 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.Server Started @166316ms
[junit4] 2> 164356 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/tempDir-001/jetty3, hostPort=40875, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores}
[junit4] 2> 164356 ERROR (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 164356 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.2
[junit4] 2> 164356 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 164356 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 164356 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-03-03T14:24:16.198742Z
[junit4] 2> 164359 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 164359 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/solr.xml
[junit4] 2> 164366 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 164367 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33001/solr
[junit4] 2> 164375 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 164388 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40875_
[junit4] 2> 164390 INFO (zkCallback-316-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 164390 INFO (zkCallback-326-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 164391 INFO (zkCallback-338-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 164390 INFO (zkCallback-332-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 164391 INFO (zkCallback-320-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 164493 INFO (zkCallback-326-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 164493 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 164504 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores
[junit4] 2> 164504 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 164518 INFO (OverseerStateUpdate-97553681458790404-127.0.0.1:33520_-n_0000000000) [ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 164620 INFO (zkCallback-338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 164620 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 164620 INFO (zkCallback-326-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 165529 WARN (coreLoadExecutor-640-thread-1) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 165530 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
[junit4] 2> 165545 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 165643 WARN (coreLoadExecutor-640-thread-1) [ ] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 165646 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 165654 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 165654 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/collection1/data/]
[junit4] 2> 165654 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
[junit4] 2> 165656 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 165661 WARN (coreLoadExecutor-640-thread-1) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 165672 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 165672 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 165675 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 165675 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 165676 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 165676 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@14cb4bf[collection1] main]
[junit4] 2> 165677 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 165677 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 165677 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 165678 INFO (searcherExecutor-641-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@14cb4bf[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 165678 INFO (coreLoadExecutor-640-thread-1) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560858913690091520
[junit4] 2> 165681 INFO (coreZkRegister-635-thread-1) [ ] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 165681 INFO (updateExecutor-335-thread-1) [ ] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 165682 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 165682 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 165682 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 165682 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 165682 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:45697/collection1/] and I am [http://127.0.0.1:40875/collection1/]
[junit4] 2> 165685 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:45697]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:40875_&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 165687 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49486,localport=45697], receiveBufferSize:531000
[junit4] 2> 165690 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38629,localport=50502], receiveBufferSize=530904
[junit4] 2> 165697 INFO (qtp28947811-1540) [ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 165698 INFO (qtp28947811-1540) [ ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard2 of collection1) have state: recovering
[junit4] 2> 165698 INFO (qtp28947811-1540) [ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:40875_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"http://127.0.0.1:40875","node_name":"127.0.0.1:40875_","state":"down"}
[junit4] 2> 165785 INFO (zkCallback-326-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 165785 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 165785 INFO (zkCallback-338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 166124 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 166124 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 30000 for each attempt
[junit4] 2> 166124 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
[junit4] 2> 166698 INFO (qtp28947811-1540) [ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:40875_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"http://127.0.0.1:40875","node_name":"127.0.0.1:40875_","state":"recovering"}
[junit4] 2> 166699 INFO (qtp28947811-1540) [ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 166699 INFO (qtp28947811-1540) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:40875_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1001
[junit4] 2> 173699 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:45697/collection1/] - recoveringAfterStartup=[true]
[junit4] 2> 173700 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.u.PeerSync PeerSync: core=collection1 url=http://127.0.0.1:40875 START replicas=[http://127.0.0.1:45697/collection1/] nUpdates=100
[junit4] 2> 173701 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49518,localport=45697], receiveBufferSize:531000
[junit4] 2> 173702 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38629,localport=50534], receiveBufferSize=530904
[junit4] 2> 173703 INFO (qtp28947811-1540) [ ] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
[junit4] 2> 173703 INFO (qtp28947811-1540) [ ] o.a.s.c.S.Request [collection1] webapp= path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 173704 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
[junit4] 2> 173704 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync
[junit4] 2> 173704 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 173704 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 173704 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 173704 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy PeerSync stage of recovery was successful.
[junit4] 2> 173704 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy Replaying updates buffered during PeerSync.
[junit4] 2> 173704 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy No replay needed.
[junit4] 2> 173704 INFO (recoveryExecutor-336-thread-1) [ ] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
[junit4] 2> 173706 INFO (zkCallback-326-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 173706 INFO (zkCallback-338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 173706 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 174128 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
[junit4] 2> 174129 INFO (SocketProxy-Acceptor-33520) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=48890,localport=33520], receiveBufferSize:531000
[junit4] 2> 174132 INFO (SocketProxy-Acceptor-33520) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=32874,localport=52554], receiveBufferSize=530904
[junit4] 2> 174133 INFO (qtp1505883-1503) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 174133 INFO (qtp1505883-1503) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 174133 INFO (qtp1505883-1503) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 174134 INFO (qtp1505883-1503) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 0
[junit4] 2> 174135 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43876,localport=46336], receiveBufferSize:531000
[junit4] 2> 174136 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36026,localport=56818], receiveBufferSize=530904
[junit4] 2> 174140 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43880,localport=46336], receiveBufferSize:531000
[junit4] 2> 174140 INFO (SocketProxy-Acceptor-40875) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42294,localport=40875], receiveBufferSize:531000
[junit4] 2> 174140 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49538,localport=45697], receiveBufferSize:531000
[junit4] 2> 174140 INFO (SocketProxy-Acceptor-40875) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36998,localport=46852], receiveBufferSize=530904
[junit4] 2> 174141 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38629,localport=50554], receiveBufferSize=530904
[junit4] 2> 174144 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36026,localport=56824], receiveBufferSize=530904
[junit4] 2> 174146 INFO (qtp28947811-1537) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 174146 INFO (qtp20220018-1565) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 174146 INFO (qtp28947811-1537) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 174147 INFO (qtp20220018-1565) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 174148 INFO (qtp20220018-1565) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 174148 INFO (qtp1920943-1598) [ ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 174148 INFO (qtp28947811-1537) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 174149 INFO (qtp1920943-1598) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 174149 INFO (qtp28947811-1537) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46336/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 3
[junit4] 2> 174149 INFO (qtp1920943-1598) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 174149 INFO (qtp1920943-1598) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46336/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 2
[junit4] 2> 174148 INFO (qtp20220018-1565) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46336/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 2
[junit4] 2> 174150 INFO (qtp20220018-1569) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp= path=/update params={_stateVer_=collection1:11&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 11
[junit4] 2> 174152 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49542,localport=45697], receiveBufferSize:531000
[junit4] 2> 174152 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38629,localport=50558], receiveBufferSize=530904
[junit4] 2> 174157 INFO (qtp28947811-1540) [ ] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=1
[junit4] 2> 174159 INFO (SocketProxy-Acceptor-40875) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42308,localport=40875], receiveBufferSize:531000
[junit4] 2> 174161 INFO (SocketProxy-Acceptor-40875) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36998,localport=46864], receiveBufferSize=530904
[junit4] 2> 174162 INFO (qtp1920943-1594) [ ] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 174164 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43900,localport=46336], receiveBufferSize:531000
[junit4] 2> 174169 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36026,localport=56842], receiveBufferSize=530904
[junit4] 2> 174171 INFO (qtp20220018-1571) [ ] o.a.s.c.S.Request [collection1] webapp= path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 176174 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43970,localport=46336], receiveBufferSize:531000
[junit4] 2> 176175 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36026,localport=56912], receiveBufferSize=530904
[junit4] 2> 176176 INFO (qtp20220018-1569) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&maxShardsPerNode=1&name=c8n_crud_1x2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 176178 INFO (OverseerThreadFactory-605-thread-1) [ ] o.a.s.c.CreateCollectionCmd Create collection c8n_crud_1x2
[junit4] 2> 176178 INFO (OverseerThreadFactory-605-thread-1) [ ] o.a.s.c.CreateCollectionCmd Only one config set found in zk - using it:conf1
[junit4] 2> 176282 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43982,localport=46336], receiveBufferSize:531000
[junit4] 2> 176282 INFO (SocketProxy-Acceptor-40875) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42394,localport=40875], receiveBufferSize:531000
[junit4] 2> 176282 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36026,localport=56926], receiveBufferSize=530904
[junit4] 2> 176283 INFO (SocketProxy-Acceptor-40875) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36998,localport=46954], receiveBufferSize=530904
[junit4] 2> 176283 INFO (qtp20220018-1564) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica1&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2
[junit4] 2> 176286 INFO (qtp1920943-1598) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica2&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2
[junit4] 2> 176988 INFO (zkCallback-338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 176988 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 177895 WARN (qtp1920943-1598) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 177897 INFO (qtp1920943-1598) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
[junit4] 2> 177898 WARN (qtp20220018-1564) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 177899 INFO (qtp20220018-1564) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.2
[junit4] 2> 177907 INFO (qtp1920943-1598) [ ] o.a.s.s.IndexSchema [c8n_crud_1x2_shard1_replica2] Schema name=test
[junit4] 2> 177915 INFO (qtp20220018-1564) [ ] o.a.s.s.IndexSchema [c8n_crud_1x2_shard1_replica1] Schema name=test
[junit4] 2> 178016 WARN (qtp1920943-1598) [ ] o.a.s.s.IndexSchema [c8n_crud_1x2_shard1_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 178019 INFO (qtp1920943-1598) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 178026 INFO (qtp1920943-1598) [ ] o.a.s.c.CoreContainer Creating SolrCore 'c8n_crud_1x2_shard1_replica2' using configuration from collection c8n_crud_1x2
[junit4] 2> 178027 INFO (qtp1920943-1598) [ ] o.a.s.c.SolrCore [[c8n_crud_1x2_shard1_replica2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/c8n_crud_1x2_shard1_replica2], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-3-001/cores/c8n_crud_1x2_shard1_replica2/data/]
[junit4] 2> 178027 INFO (qtp1920943-1598) [ ] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
[junit4] 2> 178029 INFO (qtp1920943-1598) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 178034 WARN (qtp20220018-1564) [ ] o.a.s.s.IndexSchema [c8n_crud_1x2_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 178035 WARN (qtp1920943-1598) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 178035 INFO (qtp20220018-1564) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 178045 INFO (qtp20220018-1564) [ ] o.a.s.c.CoreContainer Creating SolrCore 'c8n_crud_1x2_shard1_replica1' using configuration from collection c8n_crud_1x2
[junit4] 2> 178046 INFO (qtp20220018-1564) [ ] o.a.s.c.SolrCore [[c8n_crud_1x2_shard1_replica1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/c8n_crud_1x2_shard1_replica1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_2C617D978245810C-001/shard-2-001/cores/c8n_crud_1x2_shard1_replica1/data/]
[junit4] 2> 178046 INFO (qtp20220018-1564) [ ] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@195bc
[junit4] 2> 178047 INFO (qtp20220018-1564) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=63.849609375, floorSegmentMB=0.62109375, forceMergeDeletesPctAllowed=19.653036131467424, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 178048 INFO (qtp1920943-1598) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 178048 INFO (qtp1920943-1598) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 178052 WARN (qtp20220018-1564) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 178055 INFO (qtp1920943-1598) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 178055 INFO (qtp1920943-1598) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 178055 INFO (qtp1920943-1598) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 178055 INFO (qtp1920943-1598) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2405a6[c8n_crud_1x2_shard1_replica2] main]
[junit4] 2> 178056 INFO (qtp1920943-1598) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 178056 INFO (qtp1920943-1598) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 178057 INFO (qtp1920943-1598) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 178058 INFO (searcherExecutor-646-thread-1) [ ] o.a.s.c.SolrCore [c8n_crud_1x2_shard1_replica2] Registered new searcher Searcher@2405a6[c8n_crud_1x2_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 178058 INFO (qtp1920943-1598) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560858926671462400
[junit4] 2> 178064 INFO (qtp1920943-1598) [ ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 178068 INFO (qtp20220018-1564) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 178068 INFO (qtp20220018-1564) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 178074 INFO (qtp20220018-1564) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 178074 INFO (qtp20220018-1564) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 178074 INFO (qtp20220018-1564) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=54.92578125, floorSegmentMB=1.4228515625, forceMergeDeletesPctAllowed=4.506987706237508, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 178074 INFO (qtp20220018-1564) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1148aa8[c8n_crud_1x2_shard1_replica1] main]
[junit4] 2> 178075 INFO (qtp20220018-1564) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 178075 INFO (qtp20220018-1564) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 178075 INFO (qtp20220018-1564) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 178076 INFO (qtp20220018-1564) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1560858926690336768
[junit4] 2> 178077 INFO (searcherExecutor-648-thread-1) [ ] o.a.s.c.SolrCore [c8n_crud_1x2_shard1_replica1] Registered new searcher Searcher@1148aa8[c8n_crud_1x2_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 178167 INFO (zkCallback-338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 178167 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 178564 INFO (qtp1920943-1598) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 178564 INFO (qtp1920943-1598) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 178564 INFO (qtp1920943-1598) [ ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40875/c8n_crud_1x2_shard1_replica2/
[junit4] 2> 178564 INFO (qtp1920943-1598) [ ] o.a.s.u.PeerSync PeerSync: core=c8n_crud_1x2_shard1_replica2 url=http://127.0.0.1:40875 START replicas=[http://127.0.0.1:46336/c8n_crud_1x2_shard1_replica1/] nUpdates=100
[junit4] 2> 178565 INFO (qtp1920943-1598) [ ] o.a.s.u.PeerSync PeerSync: core=c8n_crud_1x2_shard1_replica2 url=http://127.0.0.1:40875 DONE. We have no versions. sync failed.
[junit4] 2> 178565 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44000,localport=46336], receiveBufferSize:531000
[junit4] 2> 178566 INFO (SocketProxy-Acceptor-46336) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36026,localport=56942], receiveBufferSize=530904
[junit4] 2> 178568 INFO (qtp20220018-1571) [ ] o.a.s.c.S.Request [c8n_crud_1x2_shard1_replica1] webapp= path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 178568 INFO (qtp1920943-1598) [ ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 178568 INFO (qtp1920943-1598) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 178571 INFO (qtp1920943-1598) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40875/c8n_crud_1x2_shard1_replica2/ shard1
[junit4] 2> 178673 INFO (zkCallback-338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 178673 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 178721 INFO (qtp1920943-1598) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 178725 INFO (qtp1920943-1598) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica2&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2} status=0 QTime=2438
[junit4] 2> 178824 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 178824 INFO (zkCallback-338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 179083 INFO (qtp20220018-1564) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica1&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2} status=0 QTime=2800
[junit4] 2> 179086 INFO (qtp20220018-1569) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 179183 INFO (zkCallback-338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 179183 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
[junit4] 2> 180087 INFO (qtp20220018-1569) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&maxShardsPerNode=1&name=c8n_crud_1x2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3910
[junit4] 2> 180088 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Found 2 replicas and leader on 127.0.0.1:40875_ for shard1 in c8n_crud_1x2
[junit4] 2> 180088 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Took 0.0 ms to see all replicas become active.
[junit4] 2> 180100 INFO (SocketProxy-Acceptor-33520) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49042,localport=33520], receiveBufferSize:531000
[junit4] 2> 180100 INFO (SocketProxy-Acceptor-33520) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=32874,localport=52706], receiveBufferSize=530904
[junit4] 2> 180102 INFO (qtp1505883-1502) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=c8n_crud_1x2&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 180103 INFO (OverseerThreadFactory-605-thread-2) [ ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 180103 INFO (OverseerCollectionConfigSetProcessor-97553681458790404-127.0.0.1:33520_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 180107 INFO (qtp20220018-1566) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.c8n_crud_1x2.shard1.replica1
[junit4] 2> 180107 INFO (qtp1920943-1600) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.c8n_crud_1x2.shard1.replica2
[junit4] 2> 180108 INFO (qtp1920943-1600) [ ] o.a.s.c.SolrCore [c8n_crud_1x2_shard1_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@d026d0
[junit4] 2> 180108 INFO (qtp20220018-1566) [ ] o.a.s.c.SolrCore [c8n_crud_1x2_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@673ca3
[junit4] 2> 180177 INFO (qtp1920943-1600) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.c8n_crud_1x2.shard1.replica2
[junit4] 2> 180191 WARN (zkCallback-332-thread-2) [ ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.solr.common.SolrException: SolrCore not found:c8n_crud_1x2_shard1_replica1 in [collection1]
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:292)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:268)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1161)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 180193 INFO (qtp1920943-1600) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=c8n_crud_1x2_shard1_replica2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=87
[junit4] 2> 180197 INFO (qtp20220018-1566) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.c8n_crud_1x2.shard1.replica1
[junit4] 2> 180220 INFO (qtp20220018-1566) [ ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 180220 INFO (qtp20220018-1566) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=c8n_crud_1x2_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=115
[junit4] 2> 180924 INFO (qtp1505883-1502) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=c8n_crud_1x2&action=DELETE&wt=javabin&version=2} status=0 QTime=822
[junit4] 2> 180927 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49678,localport=45697], receiveBufferSize:531000
[junit4] 2> 180927 INFO (SocketProxy-Acceptor-45697) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38629,localport=50694], receiveBufferSize=530904
[junit4] 2> 180928 INFO (qtp28947811-1537) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&maxShardsPerNode=1&name=collMinRf_1x3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 180930 INFO (OverseerThreadFactory-605-thread-3) [ ] o.a.s.c.CreateCollectionCmd Create collection collMinRf_1x3
[junit4] 2> 180930 INFO (OverseerThreadFactory-605-thread-3) [ ] o.a.s.c.CreateCollectionCmd Only one config set found in zk - using it:conf1
[junit4] 2> 180930 INFO (OverseerCollectionConfigSetProcessor-97553681458790404-127.0.0.1:33520_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 181133 INFO (SocketProxy-Acceptor-33520) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49052,localport=33520], receiveBufferSize:531000
[junit4] 2> 181134 INFO (SocketProxy-Acceptor-33520) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=32874,localport=52716], receiveBufferSize=530904
[junit4] 2> 181136 INFO (qtp20220018-1564) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=collMinRf_1x3_shard1_replica2&action=CREATE&numShards=1&collection=collMinRf_1x3&shard=shard1&wt=javabin&version=2
[junit4] 2> 181136 INFO (qtp1505883-1503) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=collMinRf_1x3_shard1_replica3&action=CREATE&numShards=1&collection=collMinRf_1x3&shard=shard1&wt=javabin&version=2
[junit4] 2> 181136 INFO (qtp1920943-1595) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=collMinRf_1x3_shard1_replica1&action=CREATE&numShards=1&collection=collMinRf_1x3&shard=shard1&wt=javabin&version=2
[junit4] 2> 181241 INFO (zkCallback-316-thread-6) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has occurred - updating... (live nodes size: [4])
[junit4] 2> 181241 INFO (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has occurred - updating... (live nodes size: [4])
[junit4] 2> 181241 INFO (zkCallback-338-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has occurred - updating... (live nodes size: [4])
[junit4] 2> 182147 WARN (qtp1505883-1503) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 182147 WARN (qtp20220018-1564) [ ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 182147 WARN (qtp1920943-1595) [ ] o.a.s.c.Config Beginn
[...truncated too long message...]
pe:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [1])
[junit4] 2> 304176 INFO (zkCallback-338-thread-9) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has occurred - updating... (live nodes size: [1])
[junit4] 2> 304278 INFO (zkCallback-338-thread-9) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has occurred - updating... (live nodes size: [1])
[junit4] 2> 305648 WARN (zkCallback-332-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 305649 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 305651 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@8793ae{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 305651 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1e15ac4{/,null,UNAVAILABLE}
[junit4] 2> 305652 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ChaosMonkey monkey: stop shard! 40875
[junit4] 2> 305652 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=9696251
[junit4] 2> 305658 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.Overseer Overseer (id=97553681458790416-127.0.0.1:40875_-n_0000000004) closing
[junit4] 2> 305659 INFO (zkCallback-338-thread-7) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has occurred - updating... (live nodes size: [1])
[junit4] 2> 305659 INFO (OverseerStateUpdate-97553681458790416-127.0.0.1:40875_-n_0000000004) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40875_
[junit4] 2> 305660 INFO (zkCallback-320-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 306556 WARN (zkCallback-338-thread-4) [ ] o.a.s.c.SyncStrategy Closed, skipping sync up.
[junit4] 2> 306556 INFO (zkCallback-338-thread-4) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 306556 INFO (zkCallback-338-thread-4) [ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1a5b594
[junit4] 2> 306590 INFO (zkCallback-338-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 306654 WARN (zkCallback-338-thread-3) [ ] o.a.s.c.SyncStrategy Closed, skipping sync up.
[junit4] 2> 306655 INFO (zkCallback-338-thread-3) [ ] o.a.s.c.SolrCore [collMinRf_1x3_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@4556e5
[junit4] 2> 306685 INFO (zkCallback-338-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collMinRf_1x3.shard1.replica1
[junit4] 2> 307159 WARN (zkCallback-338-thread-7) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections/collMinRf_1x3/state.json]
[junit4] 2> 307160 WARN (zkCallback-338-thread-9) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 307161 WARN (zkCallback-338-thread-6) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 307161 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 307162 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7dc250{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 307162 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@e1ab35{/,null,UNAVAILABLE}
[junit4] 2> 307163 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ChaosMonkey monkey: stop shard! 33520
[junit4] 2> 307164 INFO (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33001 33001
[junit4] 2> 307189 INFO (Thread-336) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33001 33001
[junit4] 2> 307190 WARN (Thread-336) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/clusterprops.json
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 4 /solr/collections/collection1/state.json
[junit4] 2> 4 /solr/collections/collMinRf_1x3/state.json
[junit4] 2> 3 /solr/collections/c8n_1x3/state.json
[junit4] 2> 3 /solr/collections/c8n_1x2_leader_session_loss/state.json
[junit4] 2> 2 /solr/overseer_elect/election/97553681458790412-127.0.0.1:46336_-n_0000000002
[junit4] 2> 2 /solr/collections/c8n_1x2/state.json
[junit4] 2> 2 /solr/collections/c8n_crud_1x2/state.json
[junit4] 2> 2 /solr/collections/collMinRf_1x3/leader_elect/shard1/election/97553681458790404-core_node1-n_0000000001
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard2/election/97553681458790409-core_node1-n_0000000000
[junit4] 2> 2 /solr/collections/collMinRf_1x3/leader_elect/shard1/election/97553681458790412-core_node2-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 131 /solr/overseer/collection-queue-work
[junit4] 2> 84 /solr/overseer/queue
[junit4] 2> 40 /solr/overseer/queue-work
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 6 /solr/collections
[junit4] 2>
[junit4] 2> 307190 WARN (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.SocketProxy Closing 9 connections to: http://127.0.0.1:33520/, target: http://127.0.0.1:32874/
[junit4] 2> 307190 WARN (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.SocketProxy Closing 5 connections to: http://127.0.0.1:45697/, target: http://127.0.0.1:38629/
[junit4] 2> 307190 WARN (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.SocketProxy Closing 13 connections to: http://127.0.0.1:46336/, target: http://127.0.0.1:36026/
[junit4] 2> 307190 WARN (TEST-HttpPartitionTest.test-seed#[2C617D978245810C]) [ ] o.a.s.c.SocketProxy Closing 5 connections to: http://127.0.0.1:40875/, target: http://127.0.0.1:36998/
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HttpPartitionTest -Dtests.method=test -Dtests.seed=2C617D978245810C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mer-KE -Dtests.timezone=Europe/Riga -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 151s J0 | HttpPartitionTest.test <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=2007, name=SocketProxy-Response-32874:49790, state=RUNNABLE, group=TGRP-HttpPartitionTest]
[junit4] > at __randomizedtesting.SeedInfo.seed([2C617D978245810C:A435424D2CB9ECF4]:0)
[junit4] > Caused by: java.lang.RuntimeException: java.net.SocketException: Socket is closed
[junit4] > at __randomizedtesting.SeedInfo.seed([2C617D978245810C]:0)
[junit4] > at org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:347)
[junit4] > Caused by: java.net.SocketException: Socket is closed
[junit4] > at java.base/java.net.Socket.setSoTimeout(Socket.java:1137)
[junit4] > at org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:344)
[junit4] 2> 307193 INFO (SUITE-HttpPartitionTest-seed#[2C617D978245810C]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Mar 03, 2017 2:26:39 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62), sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=mer-KE, timezone=Europe/Riga
[junit4] 2> NOTE: Linux 4.4.0-53-generic i386/Oracle Corporation 9-ea (32-bit)/cpus=12,threads=1,free=37534768,total=288096256
[junit4] 2> NOTE: All tests run in this JVM: [TestQuerySenderNoQuery, TestSolrCLIRunExample, TestQueryWrapperFilter, FastVectorHighlighterTest, BlockCacheTest, AnalysisErrorHandlingTest, TestNRTOpen, AlternateDirectoryTest, TestCustomDocTransformer, MergeStrategyTest, SolrXmlInZkTest, RegexBoostProcessorTest, NotRequiredUniqueKeyTest, TestSQLHandler, LeaderFailureAfterFreshStartTest, TestLRUStatsCache, TestReRankQParserPlugin, DocumentAnalysisRequestHandlerTest, TestRawResponseWriter, TestRealTimeGet, TestCopyFieldCollectionResource, UUIDFieldTest, HttpPartitionTest]
[junit4] Completed [97/680 (1!)] on J0 in 152.61s, 1 test, 1 error <<< FAILURES!
[...truncated 53440 lines...]
[JENKINS-EA] Lucene-Solr-6.4-Linux (32bit/jdk-9-ea+158) - Build #
127 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.4-Linux/127/
Java: 32bit/jdk-9-ea+158 -server -XX:+UseSerialGC
2 tests failed.
FAILED: org.apache.solr.metrics.SolrMetricManagerTest.testClearMetrics
Error Message:
expected:<88> but was:<89>
Stack Trace:
java.lang.AssertionError: expected:<88> but was:<89>
at __randomizedtesting.SeedInfo.seed([5E4DC1CB554046AD:1AEF46742D27BD5D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.metrics.SolrMetricManagerTest.testClearMetrics(SolrMetricManagerTest.java:141)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:547)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.testDelegationTokenCancelFail
Error Message:
expected:<200> but was:<404>
Stack Trace:
java.lang.AssertionError: expected:<200> but was:<404>
at __randomizedtesting.SeedInfo.seed([5E4DC1CB554046AD:36F2F4E185DA5441]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.cancelDelegationToken(TestDelegationWithHadoopAuth.java:128)
at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.testDelegationTokenCancelFail(TestDelegationWithHadoopAuth.java:290)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:547)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12646 lines...]
[junit4] Suite: org.apache.solr.metrics.SolrMetricManagerTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.SolrMetricManagerTest_5E4DC1CB554046AD-001/init-core-data-001
[junit4] 2> 1961968 INFO (SUITE-SolrMetricManagerTest-seed#[5E4DC1CB554046AD]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 1961969 INFO (TEST-SolrMetricManagerTest.testReporters-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testReporters
[junit4] 2> 1961973 INFO (TEST-SolrMetricManagerTest.testReporters-seed#[5E4DC1CB554046AD]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.jvm
[junit4] 2> 1961973 INFO (TEST-SolrMetricManagerTest.testReporters-seed#[5E4DC1CB554046AD]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 1961974 INFO (TEST-SolrMetricManagerTest.testReporters-seed#[5E4DC1CB554046AD]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
[junit4] 2> 1961974 INFO (TEST-SolrMetricManagerTest.testReporters-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testReporters
[junit4] 2> 1961975 INFO (TEST-SolrMetricManagerTest.testSimpleMetrics-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSimpleMetrics
[junit4] 2> 1961975 INFO (TEST-SolrMetricManagerTest.testSimpleMetrics-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSimpleMetrics
[junit4] 2> 1961977 INFO (TEST-SolrMetricManagerTest.testOverridableRegistryName-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOverridableRegistryName
[junit4] 2> 1961977 INFO (TEST-SolrMetricManagerTest.testOverridableRegistryName-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testOverridableRegistryName
[junit4] 2> 1961978 INFO (TEST-SolrMetricManagerTest.testClearMetrics-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testClearMetrics
[junit4] 2> 1961989 INFO (TEST-SolrMetricManagerTest.testClearMetrics-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testClearMetrics
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SolrMetricManagerTest -Dtests.method=testClearMetrics -Dtests.seed=5E4DC1CB554046AD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-MA -Dtests.timezone=PST8PDT -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 0.01s J1 | SolrMetricManagerTest.testClearMetrics <<<
[junit4] > Throwable #1: java.lang.AssertionError: expected:<88> but was:<89>
[junit4] > at __randomizedtesting.SeedInfo.seed([5E4DC1CB554046AD:1AEF46742D27BD5D]:0)
[junit4] > at org.apache.solr.metrics.SolrMetricManagerTest.testClearMetrics(SolrMetricManagerTest.java:141)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:547)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 1961991 INFO (TEST-SolrMetricManagerTest.testRegisterAll-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testRegisterAll
[junit4] 2> 1961991 INFO (TEST-SolrMetricManagerTest.testRegisterAll-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testRegisterAll
[junit4] 2> 1961992 INFO (TEST-SolrMetricManagerTest.testSwapRegistries-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSwapRegistries
[junit4] 2> 1961994 INFO (TEST-SolrMetricManagerTest.testSwapRegistries-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSwapRegistries
[junit4] 2> 1961995 INFO (TEST-SolrMetricManagerTest.testRegistryName-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testRegistryName
[junit4] 2> 1961995 INFO (TEST-SolrMetricManagerTest.testRegistryName-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testRegistryName
[junit4] 2> 1961995 INFO (SUITE-SolrMetricManagerTest-seed#[5E4DC1CB554046AD]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.SolrMetricManagerTest_5E4DC1CB554046AD-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=136, maxMBSortInHeap=6.422318540018317, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=fr-MA, timezone=PST8PDT
[junit4] 2> NOTE: Linux 4.4.0-53-generic i386/Oracle Corporation 9-ea (32-bit)/cpus=12,threads=1,free=129315424,total=463159296
[junit4] 2> NOTE: All tests run in this JVM: [DistribJoinFromCollectionTest, ShardRoutingCustomTest, TestDeleteCollectionOnDownNodes, TestFilteredDocIdSet, TestManagedStopFilterFactory, TestRandomCollapseQParserPlugin, BasicAuthIntegrationTest, LoggingHandlerTest, OverseerCollectionConfigSetProcessorTest, TestInfoStreamLogging, TestCloudManagedSchema, TestAuthenticationFramework, TestSweetSpotSimilarityFactory, SpellCheckComponentTest, DocValuesTest, TestHdfsUpdateLog, SoftAutoCommitTest, DistributedFacetPivotWhiteBoxTest, TestRecoveryHdfs, SolrMetricReporterTest, TestSuggestSpellingConverter, RankQueryTest, TestElisionMultitermQuery, TestSearchPerf, MultiTermTest, CoreAdminCreateDiscoverTest, TestBM25SimilarityFactory, SolrInfoMBeanTest, SolrCLIZkUtilsTest, TestBulkSchemaAPI, TestSolrCoreSnapshots, TestTestInjection, FullHLLTest, SSLMigrationTest, SampleTest, TermsComponentTest, TestQueryTypes, TestInitQParser, TestConfigReload, TestStressCloudBlindAtomicUpdates, TestFiltering, OpenCloseCoreStressTest, CopyFieldTest, TestCloudPivotFacet, RulesTest, TestLMDirichletSimilarityFactory, ClassificationUpdateProcessorTest, CustomCollectionTest, TestLRUCache, TestDefaultSearchFieldResource, DocValuesNotIndexedTest, AnalyticsQueryTest, DistributedTermsComponentTest, DistributedFacetPivotLongTailTest, IndexSchemaRuntimeFieldTest, SparseHLLTest, TestExclusionRuleCollectionAccess, SolrCmdDistributorTest, OverseerStatusTest, TestSimpleTrackingShardHandler, CachingDirectoryFactoryTest, TestMiniSolrCloudClusterSSL, TestExactSharedStatsCache, HdfsRestartWhileUpdatingTest, DistributedMLTComponentTest, RAMDirectoryFactoryTest, SimpleMLTQParserTest, JsonLoaderTest, TestJavabinTupleStreamParser, SearchHandlerTest, HttpSolrCallGetCoreTest, TestRawTransformer, TestManagedSchemaThreadSafety, CSVRequestHandlerTest, DistributedIntervalFacetingTest, DocumentBuilderTest, DeleteNodeTest, StressHdfsTest, TestDistributedGrouping, ZkCLITest, JvmMetricsTest, ZkControllerTest, TestAnalyzeInfixSuggestions, TestRandomRequestDistribution, RecoveryAfterSoftCommitTest, TestUninvertingReader, ExitableDirectoryReaderTest, ConfigSetsAPITest, SpatialFilterTest, AtomicUpdatesTest, TestPKIAuthenticationPlugin, ConvertedLegacyTest, TestSubQueryTransformer, FileUtilsTest, ClusterStateUpdateTest, TestStressVersions, DirectSolrSpellCheckerTest, DocValuesMissingTest, SchemaVersionSpecificBehaviorTest, TestReqParamsAPI, TestRequestForwarding, TestFastOutputStream, TestBackupRepositoryFactory, TestFieldCacheSortRandom, ShardRoutingTest, TestSimpleQParserPlugin, WordBreakSolrSpellCheckerTest, TestQueryUtils, IndexBasedSpellCheckerTest, TestSurroundQueryParser, SolrIndexMetricsTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, SyncSliceTest, RecoveryZkTest, TestReplicationHandler, AutoCommitTest, TestFaceting, TestRecovery, TestHashPartitioner, DistributedSpellCheckComponentTest, TestRealTimeGet, TestStressReorder, TestRangeQuery, TestCoreContainer, SimpleFacetsTest, TestSolr4Spatial, QueryElevationComponentTest, PeerSyncTest, TestFunctionQuery, TestLazyCores, DistributedQueryElevationComponentTest, SuggesterFSTTest, SolrRequestParserTest, SuggesterTest, TestTrie, PolyFieldTest, NoCacheHeaderTest, TestPseudoReturnFields, TestUpdate, TestAtomicUpdateErrorCases, QueryEqualityTest, TestRemoteStreaming, TestSolrDeletionPolicy1, DebugComponentTest, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, TestValueSourceCache, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, SolrPluginUtilsTest, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, TestComponentsName, TestLFUCache, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ActionThrottleTest, AssignTest, BaseCdcrDistributedZkTest, CdcrBootstrapTest, CollectionsAPIAsyncDistributedZkTest, ConnectionManagerTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, LeaderElectionContextKeyTest, LeaderFailoverAfterPartitionTest, LeaderInitiatedRecoveryOnShardRestartTest, MultiThreadedOCPTest, TestClusterProperties, TestCollectionAPI, TestRebalanceLeaders, TlogReplayBufferedWhileIndexingTest, VMParamsZkACLAndCredentialsProvidersTest, HdfsChaosMonkeyNothingIsSafeTest, HdfsCollectionsAPIDistributedZkTest, HdfsNNFailoverTest, HdfsRecoveryZkTest, HdfsTlogReplayBufferedWhileIndexingTest, HdfsUnloadDistributedZkTest, TestClusterStateMutator, ZkStateReaderTest, ZkStateWriterTest, RuleEngineTest, BlobRepositoryCloudTest, TestInitParams, TestReloadAndDeleteDocs, TestShardHandlerFactory, TestSolrDynamicMBean, RequestLoggingTest, TestReplicationHandlerBackup, TestSQLHandler, DistributedFacetPivotSmallAdvancedTest, DistributedFacetPivotSmallTest, SuggestComponentTest, TestPivotHelperCode, TestTrackingShardHandlerFactory, HighlighterMaxOffsetTest, TestSlowCompositeReaderWrapper, WrapperMergePolicyFactoryTest, SolrCoreMetricManagerTest, SolrMetricManagerTest]
[junit4] Completed [578/680 (1!)] on J1 in 0.04s, 7 tests, 1 failure <<< FAILURES!
[...truncated 218 lines...]
[junit4] Suite: org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_5E4DC1CB554046AD-001/init-core-data-001
[junit4] 2> 2051742 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[5E4DC1CB554046AD]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 2051745 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[5E4DC1CB554046AD]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_5E4DC1CB554046AD-001/tempDir-001
[junit4] 2> 2051745 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[5E4DC1CB554046AD]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2051745 INFO (Thread-3041) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2051746 INFO (Thread-3041) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2051846 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[5E4DC1CB554046AD]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41363
[junit4] 2> 2051852 INFO (jetty-launcher-1949-thread-2) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2051852 INFO (jetty-launcher-1949-thread-1) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 2051853 INFO (jetty-launcher-1949-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1b81e27{/solr,null,AVAILABLE}
[junit4] 2> 2051853 INFO (jetty-launcher-1949-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a35c9c{/solr,null,AVAILABLE}
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@60143e{SSL,[ssl, http/1.1]}{127.0.0.1:41176}
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@fef39d{SSL,[ssl, http/1.1]}{127.0.0.1:37127}
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-2) [ ] o.e.j.s.Server Started @2053665ms
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-1) [ ] o.e.j.s.Server Started @2053665ms
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41176}
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37127}
[junit4] 2> 2051856 ERROR (jetty-launcher-1949-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2051856 ERROR (jetty-launcher-1949-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.4.2
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.4.2
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-03-03T18:05:15.404852Z
[junit4] 2> 2051856 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-03-03T18:05:15.404893Z
[junit4] 2> 2051858 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2051860 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2051865 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2051866 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2051867 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41363/solr
[junit4] 2> 2051868 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41363/solr
[junit4] 2> 2051878 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41176_solr
[junit4] 2> 2051878 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37127_solr
[junit4] 2> 2051878 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.c.Overseer Overseer (id=97554550967304198-127.0.0.1:41176_solr-n_0000000000) starting
[junit4] 2> 2051879 INFO (zkCallback-1959-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2051879 INFO (zkCallback-1960-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2051883 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41176_solr
[junit4] 2> 2051884 INFO (zkCallback-1959-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2051900 INFO (zkCallback-1960-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2051973 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.c.CoreContainer Authentication plugin class obtained from ZK: org.apache.solr.security.HadoopAuthPlugin
[junit4] 2> 2051975 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.s.HadoopAuthPlugin Params: {delegation-token.token-kind=solr-dt, cookie.domain=127.0.0.1, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, type=simple, zk-dt-secret-manager.enable=true, signer.secret.provider=zookeeper}
[junit4] 2> 2051977 INFO (jetty-launcher-1949-thread-2) [ ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 2051978 INFO (jetty-launcher-1949-thread-2-EventThread) [ ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 2051987 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.c.CoreContainer Authentication plugin class obtained from ZK: org.apache.solr.security.HadoopAuthPlugin
[junit4] 2> 2051987 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.s.HadoopAuthPlugin Params: {delegation-token.token-kind=solr-dt, cookie.domain=127.0.0.1, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, type=simple, zk-dt-secret-manager.enable=true, signer.secret.provider=zookeeper}
[junit4] 2> 2051988 INFO (jetty-launcher-1949-thread-1) [ ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 2051989 INFO (jetty-launcher-1949-thread-1-EventThread) [ ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 2052010 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
[junit4] 2> 2052010 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Reconfiguring the default client with: org.apache.solr.security.PKIAuthenticationPlugin$HttpHeaderClientConfigurer@1a98273
[junit4] 2> 2052010 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.u.UpdateShardHandler Reconfiguring the default client with: org.apache.solr.security.PKIAuthenticationPlugin$HttpHeaderClientConfigurer@1a98273
[junit4] 2> 2052013 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_5E4DC1CB554046AD-001/tempDir-001/node2/.
[junit4] 2> 2052985 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
[junit4] 2> 2052985 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Reconfiguring the default client with: org.apache.solr.security.PKIAuthenticationPlugin$HttpHeaderClientConfigurer@9125ac
[junit4] 2> 2052985 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.u.UpdateShardHandler Reconfiguring the default client with: org.apache.solr.security.PKIAuthenticationPlugin$HttpHeaderClientConfigurer@9125ac
[junit4] 2> 2052988 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_5E4DC1CB554046AD-001/tempDir-001/node1/.
[junit4] 2> 2053323 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenRenew
[junit4] 2> 2053425 INFO (qtp19418012-12265) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOsOigFauWVvDgECFAAQE1prCN_jCgm_OSfHSaFI85PQB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053425 INFO (qtp19418012-12265) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOsOigFauWVvDgECFAAQE1prCN_jCgm_OSfHSaFI85PQB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053430 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053498 INFO (qtp22148766-12254) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOsOigFauWVvDgECFAAQE1prCN_jCgm_OSfHSaFI85PQB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053498 INFO (qtp22148766-12254) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOsOigFauWVvDgECFAAQE1prCN_jCgm_OSfHSaFI85PQB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053500 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053501 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053505 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053521 INFO (qtp19418012-12269) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOt_igFauWVvfwICFGbytnvfIfEXd9QLiswI5iPo1dZ-B3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053521 INFO (qtp19418012-12269) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOt_igFauWVvfwICFGbytnvfIfEXd9QLiswI5iPo1dZ-B3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053528 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053533 INFO (qtp22148766-12268) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOt_igFauWVvfwICFGbytnvfIfEXd9QLiswI5iPo1dZ-B3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053533 INFO (qtp22148766-12268) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOt_igFauWVvfwICFGbytnvfIfEXd9QLiswI5iPo1dZ-B3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053535 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053536 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053540 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053559 INFO (qtp19418012-12255) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOujigFauWVvowMCFME0bWbh3_pXrNh3ccWCAy2i5kFSB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053559 INFO (qtp19418012-12255) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOujigFauWVvowMCFME0bWbh3_pXrNh3ccWCAy2i5kFSB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053569 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053573 INFO (qtp22148766-12254) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOujigFauWVvowMCFME0bWbh3_pXrNh3ccWCAy2i5kFSB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053573 INFO (qtp22148766-12254) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOujigFauWVvowMCFME0bWbh3_pXrNh3ccWCAy2i5kFSB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053576 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053576 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053581 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053593 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053595 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053599 INFO (qtp19418012-12267) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOvLigFauWVvywQCFHoFGLtjUaAZPB0FI79jMwIQXY1iB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053599 INFO (qtp19418012-12267) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOvLigFauWVvywQCFHoFGLtjUaAZPB0FI79jMwIQXY1iB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053602 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053603 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053609 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053612 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053613 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053618 INFO (qtp19418012-12259) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOvLigFauWVvywQCFHoFGLtjUaAZPB0FI79jMwIQXY1iB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053618 INFO (qtp19418012-12259) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOvLigFauWVvywQCFHoFGLtjUaAZPB0FI79jMwIQXY1iB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053625 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053625 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenew-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenRenew
[junit4] 2> 2053644 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationOtherOp-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationOtherOp
[junit4] 2> 2053649 INFO (qtp19418012-12259) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params op=someSolrOperation&action=LIST&user.name=foo&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053649 INFO (qtp19418012-12259) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={op=someSolrOperation&action=LIST&user.name=foo&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053650 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationOtherOp-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=foo&p=foo&t=simple-dt&e=1488600317197&s=mO5M1iQJmwsjQjlZuIWMQKMwT2g="; Domain=127.0.0.1; Expires=Aneg 7, 04-imeg mb chubi-2017 04:05:17 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 7, 04-imeg mb chubi-2017 04:05:17 GMT
[junit4] 2> 2053650 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationOtherOp-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationOtherOp
[junit4] 2> 2053674 INFO (TEST-TestDelegationWithHadoopAuth.testZNodePaths-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testZNodePaths
[junit4] 2> 2053685 INFO (TEST-TestDelegationWithHadoopAuth.testZNodePaths-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testZNodePaths
[junit4] 2> 2053718 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancelFail-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenCancelFail
[junit4] 2> 2053733 ERROR (qtp22148766-12264) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_6]
[junit4] 2> 2053736 ERROR (qtp19418012-12255) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_6]
[junit4] 2> 2053745 ERROR (qtp22148766-12266) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_7]
[junit4] 2> 2053749 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancelFail-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenCancelFail
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDelegationWithHadoopAuth -Dtests.method=testDelegationTokenCancelFail -Dtests.seed=5E4DC1CB554046AD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mgo-CM -Dtests.timezone=Etc/GMT-3 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 0.06s J0 | TestDelegationWithHadoopAuth.testDelegationTokenCancelFail <<<
[junit4] > Throwable #1: java.lang.AssertionError: expected:<200> but was:<404>
[junit4] > at __randomizedtesting.SeedInfo.seed([5E4DC1CB554046AD:36F2F4E185DA5441]:0)
[junit4] > at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.cancelDelegationToken(TestDelegationWithHadoopAuth.java:128)
[junit4] > at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.testDelegationTokenCancelFail(TestDelegationWithHadoopAuth.java:290)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:547)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 2053764 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenewFail-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenRenewFail
[junit4] 2> 2053770 WARN (qtp19418012-12255) [ ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: bar tries to renew a token with renewer foo
[junit4] 2> 2053770 WARN (qtp19418012-12255) [ ] o.a.s.s.HadoopAuthPlugin Could not find org.apache.solr.security.authentication.requestcontinues
[junit4] 2> 2053770 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenewFail-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053773 WARN (qtp22148766-12268) [ ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: bar tries to renew a token with renewer foo
[junit4] 2> 2053773 WARN (qtp22148766-12268) [ ] o.a.s.s.HadoopAuthPlugin Could not find org.apache.solr.security.authentication.requestcontinues
[junit4] 2> 2053773 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenewFail-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053780 WARN (qtp19418012-12265) [ ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: notRenewUser tries to renew a token with renewer renewUser
[junit4] 2> 2053780 WARN (qtp19418012-12265) [ ] o.a.s.s.HadoopAuthPlugin Could not find org.apache.solr.security.authentication.requestcontinues
[junit4] 2> 2053781 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenewFail-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053783 WARN (qtp22148766-12264) [ ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: notRenewUser tries to renew a token with renewer renewUser
[junit4] 2> 2053783 WARN (qtp22148766-12264) [ ] o.a.s.s.HadoopAuthPlugin Could not find org.apache.solr.security.authentication.requestcontinues
[junit4] 2> 2053784 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenewFail-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053784 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenRenewFail-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenRenewFail
[junit4] 2> 2053802 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenVerify
[junit4] 2> 2053812 INFO (qtp19418012-12265) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOyoigFauWVwqAoCFL_iZYZ7bCj-aS822Me_llMlA3UWB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053812 INFO (qtp19418012-12265) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOyoigFauWVwqAoCFL_iZYZ7bCj-aS822Me_llMlA3UWB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053816 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053818 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053819 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053824 INFO (qtp19418012-12261) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOyoigFauWVwqAoCFL_iZYZ7bCj-aS822Me_llMlA3UWB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053824 INFO (qtp19418012-12261) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWOyoigFauWVwqAoCFL_iZYZ7bCj-aS822Me_llMlA3UWB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053828 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053828 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenVerify-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenVerify
[junit4] 2> 2053845 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenCancel
[junit4] 2> 2053855 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053859 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053865 ERROR (qtp19418012-12257) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_11]
[junit4] 2> 2053873 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053875 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053876 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053882 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053893 ERROR (qtp22148766-12258) [ ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_12]
[junit4] 2> 2053909 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2053910 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41363/solr ready
[junit4] 2> 2053916 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053923 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053923 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenCancel-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenCancel
[junit4] 2> 2053940 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenSolrClient-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenSolrClient
[junit4] 2> 2053950 WARN (TEST-TestDelegationWithHadoopAuth.testDelegationTokenSolrClient-seed#[5E4DC1CB554046AD]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Domain=127.0.0.1; Expires=Aneg 5, 01-mbegtug-1970 00:00:00 GMT; Secure; HttpOnly". Invalid 'expires' attribute: Aneg 5, 01-mbegtug-1970 00:00:00 GMT
[junit4] 2> 2053957 INFO (qtp19418012-12261) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWO0yigFauWVxMg0CFJU5qiAH2JQFDsVq9crCpMT42w_XB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2053957 INFO (qtp19418012-12261) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADZm9vA2ZvbwCKAVqVWO0yigFauWVxMg0CFJU5qiAH2JQFDsVq9crCpMT42w_XB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2053957 INFO (TEST-TestDelegationWithHadoopAuth.testDelegationTokenSolrClient-seed#[5E4DC1CB554046AD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenSolrClient
[junit4] 2> 2053959 INFO (jetty-launcher-1949-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@fef39d{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2053959 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=7996399
[junit4] 2> 2053960 INFO (jetty-launcher-1949-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@60143e{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2053960 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=8852847
[junit4] 2> 2053965 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.c.Overseer Overseer (id=97554550967304198-127.0.0.1:41176_solr-n_0000000000) closing
[junit4] 2> 2053965 INFO (OverseerStateUpdate-97554550967304198-127.0.0.1:41176_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41176_solr
[junit4] 2> 2053965 INFO (zkCallback-1960-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2055462 WARN (zkCallback-1959-thread-1) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2055462 INFO (jetty-launcher-1949-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 2055462 ERROR (Thread[Thread-3058,5,TGRP-TestDelegationWithHadoopAuth]) [ ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 2055463 INFO (jetty-launcher-1949-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1a35c9c{/solr,null,UNAVAILABLE}
[junit4] 2> 2055465 WARN (zkCallback-1960-thread-1) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2055465 INFO (jetty-launcher-1949-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
[junit4] 2> 2055466 ERROR (Thread[Thread-3061,5,TGRP-TestDelegationWithHadoopAuth]) [ ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 2055466 INFO (jetty-launcher-1949-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1b81e27{/solr,null,UNAVAILABLE}
[junit4] 2> 2055467 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[5E4DC1CB554046AD]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41363 41363
[junit4] 2> 2055486 INFO (Thread-3041) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41363 41363
[junit4] 2> 2055486 WARN (Thread-3041) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/aliases.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/clusterprops.json
[junit4] 2> 12 /solr/clusterstate.json
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_7
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_6
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_9
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_8
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_5
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_13
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_12
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_11
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_10
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/live_nodes
[junit4] 2> 12 /solr/collections
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 2055487 INFO (SUITE-TestDelegationWithHadoopAuth-seed#[5E4DC1CB554046AD]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-6.4-Linux/solr/build/solr-core/test/J0/temp/solr.security.hadoop.TestDelegationWithHadoopAuth_5E4DC1CB554046AD-001
[junit4] 2> Mar 03, 2017 6:05:19 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62), sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=mgo-CM, timezone=Etc/GMT-3
[junit4] 2> NOTE: Linux 4.4.0-53-generic i386/Oracle Corporation 9-ea (32-bit)/cpus=12,threads=1,free=193769592,total=412696576
[junit4] 2> NOTE: All tests run in this JVM: [TestSubQueryTransformerDistrib, TestXmlQParser, TestCustomDocTransformer, TestBadConfig, UUIDFieldTest, TestUniqueKeyFieldResource, DocumentAnalysisRequestHandlerTest, TestCloudSchemaless, TestManagedSchemaAPI, ConcurrentDeleteAndCreateCollectionTest, TestSSLRandomization, TestNRTOpen, SimpleCollectionCreateDeleteTest, ExplicitHLLTest, TestStressLucene, TestFieldCacheWithThreads, TestDynamicFieldResource, FileBasedSpellCheckerTest, TestFieldCache, TestComplexPhraseLeadingWildcard, HttpPartitionTest, SuggestComponentContextFilterQueryTest, TestCSVLoader, TestCorePropertiesReload, HdfsThreadLeakTest, TestIBSimilarityFactory, HdfsDirectoryTest, CdcrReplicationDistributedZkTest, TestGraphMLResponseWriter, DateRangeFieldTest, CacheHeaderTest, NumericFieldsTest, DeleteShardTest, TestReplicaProperties, StandardRequestHandlerTest, TestCloudRecovery, ShardSplitTest, CloudExitableDirectoryReaderTest, TestSha256AuthenticationProvider, TestExpandComponent, FastVectorHighlighterTest, TestImplicitCoreProperties, DirectoryFactoryTest, ConjunctionSolrSpellCheckerTest, TestStressRecovery, TestRandomFaceting, TestFieldSortValues, JavabinLoaderTest, ChaosMonkeyNothingIsSafeTest, TestDFISimilarityFactory, TestSerializedLuceneMatchVersion, TestLeaderElectionWithEmptyReplica, TestJmxIntegration, BasicZkTest, TestConfigSetsAPI, MigrateRouteKeyTest, TestBlobHandler, TestRestManager, TestFieldCacheSort, DocExpirationUpdateProcessorFactoryTest, TestSizeLimitedDistributedMap, TestSolrConfigHandler, TestBulkSchemaConcurrent, MergeStrategyTest, DateFieldTest, HighlighterConfigTest, DistributedVersionInfoTest, TestSolrCloudSnapshots, ManagedSchemaRoundRobinCloudTest, TestAuthorizationFramework, TestFoldingMultitermQuery, OutputWriterTest, TestSearcherReuse, RollingRestartTest, TestLRUStatsCache, CdcrVersionReplicationTest, PathHierarchyTokenizerFactoryTest, TestSolrConfigHandlerConcurrent, AsyncCallRequestStatusResponseTest, PreAnalyzedUpdateProcessorTest, JSONWriterTest, DefaultValueUpdateProcessorTest, TestDocumentBuilder, ReplicaListTransformerTest, TestBinaryResponseWriter, TestRandomFlRTGCloud, SolrCoreTest, CloudMLTQParserTest, PeerSyncWithIndexFingerprintCachingTest, TestChildDocTransformer, HdfsWriteToMultipleCollectionsTest, ReturnFieldsTest, TriLevelCompositeIdRoutingTest, TestSchemalessBufferedUpdates, TestSchemaResource, TestDownShardTolerantSearch, TestCryptoKeys, TestSortByMinMaxFunction, HdfsBasicDistributedZkTest, TestExceedMaxTermLength, TestJoin, BigEndianAscendingWordDeserializerTest, RequiredFieldsTest, SecurityConfHandlerTest, HLLUtilTest, CreateCollectionCleanupTest, SolrXmlInZkTest, TestSolrDeletionPolicy2, TestFastWriter, TestFieldTypeCollectionResource, TestJsonFacets, LeaderFailureAfterFreshStartTest, PeerSyncReplicationTest, TestLocalFSCloudBackupRestore, TestSegmentSorting, TestSolrCloudWithSecureImpersonation, TestTolerantUpdateProcessorRandomCloud, TestConfigSetProperties, TestConfigSets, TestCustomStream, TestSQLHandlerNonCloud, CoreMergeIndexesAdminHandlerTest, InfoHandlerTest, MetricsHandlerTest, SegmentsInfoRequestHandlerTest, StatsReloadRaceTest, DistributedDebugComponentTest, DistributedExpandComponentTest, DistributedFacetPivotLargeTest, DistributedSuggestComponentTest, TestDistributedStatsComponentCardinality, TestComplexPhraseQParserPlugin, TestGraphTermsQParserPlugin, TestMissingGroups, TestReloadDeadlock, TestSolr4Spatial2, TestSolrCoreParser, TestTrieFacet, TestMinMaxOnMultiValuedField, BlockJoinFacetRandomTest, GraphQueryTest, TestJsonRequest, PKIAuthenticationIntegrationTest, TestDelegationWithHadoopAuth]
[junit4] Completed [651/680 (2!)] on J0 in 4.76s, 8 tests, 1 failure <<< FAILURES!
[...truncated 51659 lines...]