You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/12/13 10:17:54 UTC

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_172) - Build # 3209 - Still Failing!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3209/
Java: 64bit/jdk1.8.0_172 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SaslZkACLProviderTest

Error Message:
3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest:     1) Thread[id=25258, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    2) Thread[id=25264, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)    3) Thread[id=25267, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest: 
   1) Thread[id=25258, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   2) Thread[id=25264, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   3) Thread[id=25267, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
	at __randomizedtesting.SeedInfo.seed([475B70A2D41C6BC3]:0)


FAILED:  org.apache.solr.cloud.SaslZkACLProviderTest.testSaslZkACLProvider

Error Message:
KeeperErrorCode = AuthFailed for /solr

Stack Trace:
org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for /solr
	at __randomizedtesting.SeedInfo.seed([475B70A2D41C6BC3:43AF267A4D58C8CD]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:126)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:792)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$makePath$8(SolrZkClient.java:545)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:544)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:436)
	at org.apache.solr.cloud.SaslZkACLProviderTest.setUp(SaslZkACLProviderTest.java:83)
	at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:969)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14264 lines...]
   [junit4] Suite: org.apache.solr.cloud.SaslZkACLProviderTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.SaslZkACLProviderTest_475B70A2D41C6BC3-001/init-core-data-001
   [junit4]   2> 1131330 INFO  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.s.c.SaslZkACLProviderTest ####SETUP_START testSaslZkACLProvider
   [junit4]   2> 1131330 INFO  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.s.c.SaslZkACLProviderTest ZooKeeper dataDir:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.SaslZkACLProviderTest_475B70A2D41C6BC3-001/tempDir-002/zookeeper/server1/data
   [junit4]   2> 1134516 WARN  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.d.s.c.DefaultDirectoryService You didn't change the admin password of directory service instance 'DefaultKrbServer'.  Please update the admin password as soon as possible to prevent a possible security breach.
   [junit4]   2> 1136016 INFO  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1136017 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1136017 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1136117 INFO  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.s.c.ZkTestServer start zk server on port:43377
   [junit4]   2> 1136117 INFO  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.s.c.ZkTestServer parse host and port list: localhost:43377
   [junit4]   2> 1136117 INFO  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.s.c.ZkTestServer connecting to localhost 43377
   [junit4]   2> 1136124 ERROR (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.ZooKeeperSaslServer Zookeeper Server failed to create a SaslServer to interact with a client during session initiation: 
   [junit4]   2> javax.security.sasl.SaslException: Failure to initialize security context
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:125) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.FactoryImpl.createSaslServer(FactoryImpl.java:85) ~[?:1.8.0_172]
   [junit4]   2> 	at javax.security.sasl.Sasl.createSaslServer(Sasl.java:524) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils$2.run(SecurityUtils.java:233) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils$2.run(SecurityUtils.java:229) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at java.security.AccessController.doPrivileged(Native Method) [?:1.8.0_172]
   [junit4]   2> 	at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils.createSaslServer(SecurityUtils.java:228) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperSaslServer.createSaslServer(ZooKeeperSaslServer.java:44) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperSaslServer.<init>(ZooKeeperSaslServer.java:38) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.<init>(NIOServerCnxn.java:100) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.solr.cloud.ZkTestServer$ZKServerMain$TestServerCnxn.<init>(ZkTestServer.java:262) [java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkTestServer$ZKServerMain$TestServerCnxnFactory.createConnection(ZkTestServer.java:284) [java/:?]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:220) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> Caused by: org.ietf.jgss.GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails)
   [junit4]   2> 	at sun.security.jgss.krb5.Krb5AcceptCredential.getInstance(Krb5AcceptCredential.java:87) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:127) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSManagerImpl.getCredentialElement(GSSManagerImpl.java:193) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSCredentialImpl.add(GSSCredentialImpl.java:427) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSCredentialImpl.<init>(GSSCredentialImpl.java:62) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSManagerImpl.createCredential(GSSManagerImpl.java:154) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:108) ~[?:1.8.0_172]
   [junit4]   2> 	... 14 more
   [junit4]   2> 1136148 ERROR (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.ZooKeeperSaslServer Zookeeper Server failed to create a SaslServer to interact with a client during session initiation: 
   [junit4]   2> javax.security.sasl.SaslException: Failure to initialize security context
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:125) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.FactoryImpl.createSaslServer(FactoryImpl.java:85) ~[?:1.8.0_172]
   [junit4]   2> 	at javax.security.sasl.Sasl.createSaslServer(Sasl.java:524) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils$2.run(SecurityUtils.java:233) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils$2.run(SecurityUtils.java:229) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at java.security.AccessController.doPrivileged(Native Method) [?:1.8.0_172]
   [junit4]   2> 	at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils.createSaslServer(SecurityUtils.java:228) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperSaslServer.createSaslServer(ZooKeeperSaslServer.java:44) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperSaslServer.<init>(ZooKeeperSaslServer.java:38) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.<init>(NIOServerCnxn.java:100) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.solr.cloud.ZkTestServer$ZKServerMain$TestServerCnxn.<init>(ZkTestServer.java:262) [java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkTestServer$ZKServerMain$TestServerCnxnFactory.createConnection(ZkTestServer.java:284) [java/:?]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:220) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> Caused by: org.ietf.jgss.GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails)
   [junit4]   2> 	at sun.security.jgss.krb5.Krb5AcceptCredential.getInstance(Krb5AcceptCredential.java:87) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:127) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSManagerImpl.getCredentialElement(GSSManagerImpl.java:193) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSCredentialImpl.add(GSSCredentialImpl.java:427) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSCredentialImpl.<init>(GSSCredentialImpl.java:62) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSManagerImpl.createCredential(GSSManagerImpl.java:154) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:108) ~[?:1.8.0_172]
   [junit4]   2> 	... 14 more
   [junit4]   2> 1136153 INFO  (zkConnectionManagerCallback-8460-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1136163 WARN  (NioProcessor-6) [    ] o.a.d.s.p.s.k.StoreUtils No server entry found for kerberos principal name zookeeper/localhost.localdomain@EXAMPLE.COM
   [junit4]   2> 1136163 WARN  (NioProcessor-6) [    ] o.a.d.s.KERBEROS_LOG No server entry found for kerberos principal name zookeeper/localhost.localdomain@EXAMPLE.COM
   [junit4]   2> 1136163 WARN  (NioProcessor-6) [    ] o.a.d.s.k.p.KerberosProtocolHandler Server not found in Kerberos database (7)
   [junit4]   2> 1136163 WARN  (NioProcessor-6) [    ] o.a.d.s.KERBEROS_LOG Server not found in Kerberos database (7)
   [junit4]   2> 1136166 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-SendThread(localhost:43377)) [    ] o.a.z.c.ZooKeeperSaslClient An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - Server not found in Kerberos database)]) occurred when evaluating Zookeeper Quorum Member's  received SASL token. Zookeeper Client will go to AUTH_FAILED state.
   [junit4]   2> 1136166 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-SendThread(localhost:43377)) [    ] o.a.z.ClientCnxn SASL authentication with Zookeeper Quorum member failed: javax.security.sasl.SaslException: An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - Server not found in Kerberos database)]) occurred when evaluating Zookeeper Quorum Member's  received SASL token. Zookeeper Client will go to AUTH_FAILED state.
   [junit4]   2> 1136166 WARN  (zkConnectionManagerCallback-8460-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@63a4c134 name: ZooKeeperConnection Watcher:localhost:43377 got event WatchedEvent state:AuthFailed type:None path:null path: null type: None
   [junit4]   2> 1136166 WARN  (zkConnectionManagerCallback-8460-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient received AuthFailed
   [junit4]   2> 1136166 ERROR (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.ZooKeeperSaslServer Zookeeper Server failed to create a SaslServer to interact with a client during session initiation: 
   [junit4]   2> javax.security.sasl.SaslException: Failure to initialize security context
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:125) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.FactoryImpl.createSaslServer(FactoryImpl.java:85) ~[?:1.8.0_172]
   [junit4]   2> 	at javax.security.sasl.Sasl.createSaslServer(Sasl.java:524) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils$2.run(SecurityUtils.java:233) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils$2.run(SecurityUtils.java:229) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at java.security.AccessController.doPrivileged(Native Method) [?:1.8.0_172]
   [junit4]   2> 	at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils.createSaslServer(SecurityUtils.java:228) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperSaslServer.createSaslServer(ZooKeeperSaslServer.java:44) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperSaslServer.<init>(ZooKeeperSaslServer.java:38) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.<init>(NIOServerCnxn.java:100) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.solr.cloud.ZkTestServer$ZKServerMain$TestServerCnxn.<init>(ZkTestServer.java:262) [java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkTestServer$ZKServerMain$TestServerCnxnFactory.createConnection(ZkTestServer.java:284) [java/:?]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:220) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> Caused by: org.ietf.jgss.GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails)
   [junit4]   2> 	at sun.security.jgss.krb5.Krb5AcceptCredential.getInstance(Krb5AcceptCredential.java:87) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:127) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSManagerImpl.getCredentialElement(GSSManagerImpl.java:193) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSCredentialImpl.add(GSSCredentialImpl.java:427) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSCredentialImpl.<init>(GSSCredentialImpl.java:62) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSManagerImpl.createCredential(GSSManagerImpl.java:154) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:108) ~[?:1.8.0_172]
   [junit4]   2> 	... 14 more
   [junit4]   2> 1136167 INFO  (zkConnectionManagerCallback-8462-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1136177 ERROR (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.ZooKeeperSaslServer Zookeeper Server failed to create a SaslServer to interact with a client during session initiation: 
   [junit4]   2> javax.security.sasl.SaslException: Failure to initialize security context
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:125) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.FactoryImpl.createSaslServer(FactoryImpl.java:85) ~[?:1.8.0_172]
   [junit4]   2> 	at javax.security.sasl.Sasl.createSaslServer(Sasl.java:524) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils$2.run(SecurityUtils.java:233) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils$2.run(SecurityUtils.java:229) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at java.security.AccessController.doPrivileged(Native Method) [?:1.8.0_172]
   [junit4]   2> 	at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.util.SecurityUtils.createSaslServer(SecurityUtils.java:228) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperSaslServer.createSaslServer(ZooKeeperSaslServer.java:44) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperSaslServer.<init>(ZooKeeperSaslServer.java:38) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.<init>(NIOServerCnxn.java:100) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at org.apache.solr.cloud.ZkTestServer$ZKServerMain$TestServerCnxn.<init>(ZkTestServer.java:262) [java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.ZkTestServer$ZKServerMain$TestServerCnxnFactory.createConnection(ZkTestServer.java:284) [java/:?]
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:220) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> Caused by: org.ietf.jgss.GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails)
   [junit4]   2> 	at sun.security.jgss.krb5.Krb5AcceptCredential.getInstance(Krb5AcceptCredential.java:87) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:127) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSManagerImpl.getCredentialElement(GSSManagerImpl.java:193) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSCredentialImpl.add(GSSCredentialImpl.java:427) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSCredentialImpl.<init>(GSSCredentialImpl.java:62) ~[?:1.8.0_172]
   [junit4]   2> 	at sun.security.jgss.GSSManagerImpl.createCredential(GSSManagerImpl.java:154) ~[?:1.8.0_172]
   [junit4]   2> 	at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:108) ~[?:1.8.0_172]
   [junit4]   2> 	... 14 more
   [junit4]   2> 1136179 INFO  (zkConnectionManagerCallback-8464-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1136179 WARN  (NioProcessor-4) [    ] o.a.d.s.p.s.k.StoreUtils No server entry found for kerberos principal name zookeeper/localhost.localdomain@EXAMPLE.COM
   [junit4]   2> 1136179 WARN  (NioProcessor-4) [    ] o.a.d.s.KERBEROS_LOG No server entry found for kerberos principal name zookeeper/localhost.localdomain@EXAMPLE.COM
   [junit4]   2> 1136179 WARN  (NioProcessor-4) [    ] o.a.d.s.k.p.KerberosProtocolHandler Server not found in Kerberos database (7)
   [junit4]   2> 1136179 WARN  (NioProcessor-4) [    ] o.a.d.s.KERBEROS_LOG Server not found in Kerberos database (7)
   [junit4]   2> 1136180 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-SendThread(localhost:43377)) [    ] o.a.z.c.ZooKeeperSaslClient An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - Server not found in Kerberos database)]) occurred when evaluating Zookeeper Quorum Member's  received SASL token. Zookeeper Client will go to AUTH_FAILED state.
   [junit4]   2> 1136180 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-SendThread(localhost:43377)) [    ] o.a.z.ClientCnxn SASL authentication with Zookeeper Quorum member failed: javax.security.sasl.SaslException: An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - Server not found in Kerberos database)]) occurred when evaluating Zookeeper Quorum Member's  received SASL token. Zookeeper Client will go to AUTH_FAILED state.
   [junit4]   2> 1136184 WARN  (zkConnectionManagerCallback-8462-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1c64ad41 name: ZooKeeperConnection Watcher:localhost:43377/solr got event WatchedEvent state:AuthFailed type:None path:null path: null type: None
   [junit4]   2> 1136184 WARN  (zkConnectionManagerCallback-8462-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient received AuthFailed
   [junit4]   2> 1136187 WARN  (NioProcessor-5) [    ] o.a.d.s.p.s.k.StoreUtils No server entry found for kerberos principal name zookeeper/localhost.localdomain@EXAMPLE.COM
   [junit4]   2> 1136187 WARN  (NioProcessor-5) [    ] o.a.d.s.KERBEROS_LOG No server entry found for kerberos principal name zookeeper/localhost.localdomain@EXAMPLE.COM
   [junit4]   2> 1136188 WARN  (NioProcessor-5) [    ] o.a.d.s.k.p.KerberosProtocolHandler Server not found in Kerberos database (7)
   [junit4]   2> 1136188 WARN  (NioProcessor-5) [    ] o.a.d.s.KERBEROS_LOG Server not found in Kerberos database (7)
   [junit4]   2> 1136188 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-SendThread(localhost:43377)) [    ] o.a.z.c.ZooKeeperSaslClient An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - Server not found in Kerberos database)]) occurred when evaluating Zookeeper Quorum Member's  received SASL token. Zookeeper Client will go to AUTH_FAILED state.
   [junit4]   2> 1136189 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-SendThread(localhost:43377)) [    ] o.a.z.ClientCnxn SASL authentication with Zookeeper Quorum member failed: javax.security.sasl.SaslException: An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - Server not found in Kerberos database)]) occurred when evaluating Zookeeper Quorum Member's  received SASL token. Zookeeper Client will go to AUTH_FAILED state.
   [junit4]   2> 1136189 WARN  (zkConnectionManagerCallback-8464-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5743a448 name: ZooKeeperConnection Watcher:localhost:43377 got event WatchedEvent state:AuthFailed type:None path:null path: null type: None
   [junit4]   2> 1136189 WARN  (zkConnectionManagerCallback-8464-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient received AuthFailed
   [junit4]   2> 1136189 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10074c8d6780002, likely client has closed socket
   [junit4]   2> 1136290 INFO  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1136290 WARN  (Thread-4632) [    ] o.a.z.Login TGT renewal thread has been interrupted and will exit.
   [junit4]   2> 1136292 INFO  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.s.c.ZkTestServer parse host and port list: localhost:43377
   [junit4]   2> 1136292 INFO  (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]) [    ] o.a.s.c.ZkTestServer connecting to localhost 43377
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SaslZkACLProviderTest -Dtests.method=testSaslZkACLProvider -Dtests.seed=475B70A2D41C6BC3 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fi -Dtests.timezone=Europe/Andorra -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   5.69s J2 | SaslZkACLProviderTest.testSaslZkACLProvider <<<
   [junit4]    > Throwable #1: org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = AuthFailed for /solr
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([475B70A2D41C6BC3:43AF267A4D58C8CD]:0)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:126)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]    > 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:792)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.lambda$makePath$8(SolrZkClient.java:545)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:544)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:436)
   [junit4]    > 	at org.apache.solr.cloud.SaslZkACLProviderTest.setUp(SaslZkACLProviderTest.java:83)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.SaslZkACLProviderTest_475B70A2D41C6BC3-001
   [junit4]   2> Dec 13, 2018 9:55:56 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
   [junit4]   2> Dec 13, 2018 9:55:59 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest: 
   [junit4]   2>    1) Thread[id=25258, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]   2>    2) Thread[id=25264, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]   2>    3) Thread[id=25267, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]   2> Dec 13, 2018 9:55:59 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=25258, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]   2>    2) Thread[id=25264, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]   2>    3) Thread[id=25267, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]   2> 1140054 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread) [    ] o.a.z.ClientCnxn Event thread exiting due to interruption
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 1140054 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread) [    ] o.a.z.ClientCnxn Event thread exiting due to interruption
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> 1140054 ERROR (TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread) [    ] o.a.z.ClientCnxn Event thread exiting due to interruption
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504) [zookeeper-3.4.13.jar:3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03]
   [junit4]   2> Dec 13, 2018 9:55:59 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=149, maxMBSortInHeap=6.246701920092935, sim=RandomSimilarity(queryNorm=true): {}, locale=fi, timezone=Europe/Andorra
   [junit4]   2> NOTE: Linux 4.15.0-39-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=8,threads=2,free=193537080,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestLegacyNumericRangeQueryBuilder, TestDynamicFieldCollectionResource, RegexBytesRefFilterTest, TestSchemaNameResource, TestHttpShardHandlerFactory, TestRecoveryHdfs, TestAuthenticationFramework, TestMinMaxOnMultiValuedField, HdfsDirectoryTest, TestSmileRequest, ManagedSchemaRoundRobinCloudTest, TestSearchPerf, TestTestInjection, OverseerRolesTest, UninvertDocValuesMergePolicyTest, TestCloudPseudoReturnFields, ReplaceNodeTest, TestSimpleTextCodec, ZookeeperStatusHandlerTest, DefaultValueUpdateProcessorTest, TestEmbeddedSolrServerAdminHandler, TestXmlQParserPlugin, TestLMDirichletSimilarityFactory, TestSSLRandomization, PeerSyncTest, DistributedQueueTest, TestFilteredDocIdSet, NodeAddedTriggerTest, TestExclusionRuleCollectionAccess, TestLegacyNumericUtils, DeleteInactiveReplicaTest, ShardRoutingCustomTest, ClusterStateUpdateTest, ReturnFieldsTest, TestReplicationHandler, SolrCoreTest, MetricTriggerIntegrationTest, ExplicitHLLTest, TestCloudNestedDocsSort, TestSha256AuthenticationProvider, TestWordDelimiterFilterFactory, NumberUtilsTest, TestJettySolrRunner, TestClusterStateMutator, TestDocTermOrdsUninvertLimit, StatsReloadRaceTest, TestStressInPlaceUpdates, SearchHandlerTest, TestFacetMethods, HdfsRecoverLeaseTest, DocValuesMultiTest, DistanceFunctionTest, CursorMarkTest, TestRandomCollapseQParserPlugin, ResourceLoaderTest, TestWriterPerf, SolrCloudReportersTest, TestCollectionAPIs, TestChildDocTransformerHierarchy, TestJoin, TestSolrCloudWithHadoopAuthPlugin, BigEndianAscendingWordDeserializerTest, ClassificationUpdateProcessorIntegrationTest, TestSolrDeletionPolicy2, ParsingFieldUpdateProcessorsTest, CollectionsAPISolrJTest, JSONWriterTest, ScriptEngineTest, SuggesterFSTTest, SpellCheckCollatorTest, TestBinaryField, ChangedSchemaMergeTest, TestPayloadCheckQParserPlugin, ResponseLogComponentTest, PingRequestHandlerTest, DateFieldTest, TestInitQParser, SpellCheckComponentTest, TestFieldCacheSort, TestSubQueryTransformerDistrib, TestStressLucene, PhrasesIdentificationComponentTest, ChaosMonkeySafeLeaderTest, BadCopyFieldTest, BinaryUpdateRequestHandlerTest, CustomCollectionTest, AnalyticsMergeStrategyTest, TestStressUserVersions, LoggingHandlerTest, HighlighterConfigTest, TestBlendedInfixSuggestions, CdcrRequestHandlerTest, TestPushWriter, DateMathParserTest, SimpleMLTQParserTest, ConvertedLegacyTest, ForceLeaderTest, TestQuerySenderNoQuery, SolrIndexSplitterTest, HdfsAutoAddReplicasIntegrationTest, TestMiniSolrCloudClusterSSL, TestConfigSetImmutable, DebugComponentTest, TestSolrCoreParser, TestHalfAndHalfDocValues, TestCSVResponseWriter, TestRestoreCore, MigrateRouteKeyTest, URLClassifyProcessorTest, TestFuzzyAnalyzedSuggestions, CleanupOldIndexTest, TestPartialUpdateDeduplication, RequiredFieldsTest, HdfsDirectoryFactoryTest, TestPostingsSolrHighlighter, AtomicUpdateProcessorFactoryTest, CdcrBootstrapTest, SimpleCollectionCreateDeleteTest, TestTrie, NumericFieldsTest, UpdateParamsTest, CoreAdminCreateDiscoverTest, SliceStateTest, DistributedQueryElevationComponentTest, TestAuthorizationFramework, QueryResultKeyTest, TestExceedMaxTermLength, TestPullReplica, TestTolerantUpdateProcessorCloud, CoreSorterTest, TestCloudSchemaless, AnalysisErrorHandlingTest, ZkCLITest, TestSimExtremeIndexing, TestFieldCacheWithThreads, LeaderVoteWaitTimeoutTest, HdfsUnloadDistributedZkTest, DistributedIntervalFacetingTest, OutputWriterTest, SolrTestCaseJ4Test, TestDistributedGrouping, TestDocumentBuilder, TestRandomDVFaceting, TestRandomFaceting, TestSimpleTrackingShardHandler, TestSolrCoreProperties, TestTolerantSearch, PathHierarchyTokenizerFactoryTest, ProtectedTermFilterFactoryTest, TestCharFilters, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, AddReplicaTest, AsyncCallRequestStatusResponseTest, BasicZkTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CollectionPropsTest, CollectionStateFormat2Test, ConnectionManagerTest, CreateCollectionCleanupTest, CreateRoutedAliasTest, DeleteReplicaTest, FullSolrCloudDistribCmdsTest, LeaderElectionIntegrationTest, LeaderTragicEventTest, LegacyCloudClusterPropTest, MetricsHistoryIntegrationTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerStatusTest, OverseerTaskQueueTest, OverseerTest, RecoveryZkTest, SSLMigrationTest, SaslZkACLProviderTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SaslZkACLProviderTest -Dtests.seed=475B70A2D41C6BC3 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fi -Dtests.timezone=Europe/Andorra -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J2 | SaslZkACLProviderTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.cloud.SaslZkACLProviderTest: 
   [junit4]    >    1) Thread[id=25258, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]    >    2) Thread[id=25264, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]    >    3) Thread[id=25267, name=TEST-SaslZkACLProviderTest.testSaslZkACLProvider-seed#[475B70A2D41C6BC3]-EventThread, state=WAITING, group=TGRP-SaslZkACLProviderTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:504)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([475B70A2D41C6BC3]:0)
   [junit4] Completed [474/836 (1!)] on J2 in 8.74s, 1 test, 2 errors <<< FAILURES!

[...truncated 47318 lines...]
-ecj-javadoc-lint-tests:
    [mkdir] Created dir: /tmp/ecj319993079
 [ecj-lint] Compiling 935 source files to /tmp/ecj319993079
 [ecj-lint] invalid Class-Path header in manifest of jar file: /home/jenkins/.ivy2/cache/org.restlet.jee/org.restlet/jars/org.restlet-2.3.0.jar
 [ecj-lint] invalid Class-Path header in manifest of jar file: /home/jenkins/.ivy2/cache/org.restlet.jee/org.restlet.ext.servlet/jars/org.restlet.ext.servlet-2.3.0.jar
 [ecj-lint] ----------
 [ecj-lint] 1. WARNING in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test/org/apache/solr/analysis/TokenizerChainTest.java (at line 37)
 [ecj-lint] 	TokenizerChain tokenizerChain = new TokenizerChain(
 [ecj-lint] 	               ^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'tokenizerChain' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 2. WARNING in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test/org/apache/solr/cloud/ZkNodePropsTest.java (at line 48)
 [ecj-lint] 	new JavaBinCodec().marshal(zkProps.getProperties(), baos);
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 3. WARNING in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test/org/apache/solr/cloud/autoscaling/sim/SimCloudManager.java (at line 712)
 [ecj-lint] 	throw new UnsupportedOperationException("must add at least 1 node first");
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'queryRequest' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] 4. WARNING in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test/org/apache/solr/cloud/autoscaling/sim/SimCloudManager.java (at line 718)
 [ecj-lint] 	throw new UnsupportedOperationException("must add at least 1 node first");
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'queryRequest' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 5. WARNING in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test/org/apache/solr/response/TestBinaryResponseWriter.java (at line 75)
 [ecj-lint] 	new JavaBinCodec(new BinaryResponseWriter.Resolver(null, null)).marshal(nl, baos);
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] 6. WARNING in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test/org/apache/solr/response/TestBinaryResponseWriter.java (at line 77)
 [ecj-lint] 	nl = (NamedList) new JavaBinCodec().unmarshal(new ByteArrayInputStream(byteBuffer.array(), 0, byteBuffer.limit()));
 [ecj-lint] 	                 ^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 7. ERROR in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test/org/apache/solr/security/BasicAuthIntegrationTest.java (at line 72)
 [ecj-lint] 	import static java.nio.charset.StandardCharsets.UTF_8;
 [ecj-lint] 	              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import java.nio.charset.StandardCharsets.UTF_8 is never used
 [ecj-lint] ----------
 [ecj-lint] 8. ERROR in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test/org/apache/solr/security/BasicAuthIntegrationTest.java (at line 73)
 [ecj-lint] 	import static java.util.Collections.singletonMap;
 [ecj-lint] 	              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import java.util.Collections.singletonMap is never used
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 9. WARNING in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test/org/apache/solr/update/processor/DistributedUpdateProcessorTest.java (at line 39)
 [ecj-lint] 	DistributedUpdateProcessor processor = new DistributedUpdateProcessor(
 [ecj-lint] 	                           ^^^^^^^^^
 [ecj-lint] Resource leak: 'processor' is never closed
 [ecj-lint] ----------
 [ecj-lint] 9 problems (2 errors, 7 warnings)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:633: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:101: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build.xml:680: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:2099: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:2132: Compile failed; see the compiler error output for details.

Total time: 68 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2