You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "koert kuipers (Jira)" <ji...@apache.org> on 2019/09/09 22:41:00 UTC
[jira] [Created] (SPARK-29027) KafkaDelegationTokenSuite fails
koert kuipers created SPARK-29027:
-------------------------------------
Summary: KafkaDelegationTokenSuite fails
Key: SPARK-29027
URL: https://issues.apache.org/jira/browse/SPARK-29027
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Affects Versions: 3.0.0
Environment: {code}
commit 6378d4bc06cd1bb1a209bd5fb63d10ef52d75eb4
Author: Sean Owen <se...@databricks.com>
Date: Mon Sep 9 10:19:40 2019 -0500
{code}
Ubuntu 16.04 with OpenJDK 1.8 (1.8.0_222-8u222-b10-1ubuntu1~16.04.1-b10)
Reporter: koert kuipers
i am seeing consistent failure of KafkaDelegationTokenSuite on master
{code}
JsonUtilsSuite:
- parsing partitions
- parsing partitionOffsets
KafkaDelegationTokenSuite:
javax.security.sasl.SaslException: Failure to initialize security context [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails)]
at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:125)
at com.sun.security.sasl.gsskerb.FactoryImpl.createSaslServer(FactoryImpl.java:85)
at javax.security.sasl.Sasl.createSaslServer(Sasl.java:524)
at org.apache.zookeeper.server.ZooKeeperSaslServer$1.run(ZooKeeperSaslServer.java:118)
at org.apache.zookeeper.server.ZooKeeperSaslServer$1.run(ZooKeeperSaslServer.java:114)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.zookeeper.server.ZooKeeperSaslServer.createSaslServer(ZooKeeperSaslServer.java:114)
at org.apache.zookeeper.server.ZooKeeperSaslServer.<init>(ZooKeeperSaslServer.java:48)
at org.apache.zookeeper.server.NIOServerCnxn.<init>(NIOServerCnxn.java:100)
at org.apache.zookeeper.server.NIOServerCnxnFactory.createConnection(NIOServerCnxnFactory.java:156)
at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:197)
at java.lang.Thread.run(Thread.java:748)
Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos credentails)
at sun.security.jgss.krb5.Krb5AcceptCredential.getInstance(Krb5AcceptCredential.java:87)
at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:127)
at sun.security.jgss.GSSManagerImpl.getCredentialElement(GSSManagerImpl.java:193)
at sun.security.jgss.GSSCredentialImpl.add(GSSCredentialImpl.java:427)
at sun.security.jgss.GSSCredentialImpl.<init>(GSSCredentialImpl.java:62)
at sun.security.jgss.GSSManagerImpl.createCredential(GSSManagerImpl.java:154)
at com.sun.security.sasl.gsskerb.GssKrb5Server.<init>(GssKrb5Server.java:108)
... 12 more
org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite *** ABORTED ***
org.I0Itec.zkclient.exception.ZkAuthFailedException: Authentication failure
at org.I0Itec.zkclient.ZkClient.waitForKeeperState(ZkClient.java:947)
at org.I0Itec.zkclient.ZkClient.waitUntilConnected(ZkClient.java:924)
at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:1231)
at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:157)
at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:131)
at kafka.utils.ZkUtils$.createZkClientAndConnection(ZkUtils.scala:93)
at kafka.utils.ZkUtils$.apply(ZkUtils.scala:75)
at org.apache.spark.sql.kafka010.KafkaTestUtils.setupEmbeddedZookeeper(KafkaTestUtils.scala:202)
at org.apache.spark.sql.kafka010.KafkaTestUtils.setup(KafkaTestUtils.scala:243)
at org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite.beforeAll(KafkaDelegationTokenSuite.scala:49)
...
KafkaSourceOffsetSuite:
- comparison {"t":{"0":1}} <=> {"t":{"0":2}}
- comparison {"t":{"1":0,"0":1}} <=> {"t":{"1":1,"0":2}}
- comparison {"t":{"0":1},"T":{"0":0}} <=> {"t":{"0":2},"T":{"0":1}}
- comparison {"t":{"0":1}} <=> {"t":{"1":1,"0":2}}
- comparison {"t":{"0":1}} <=> {"t":{"1":3,"0":2}}
- basic serialization - deserialization
- OffsetSeqLog serialization - deserialization
- read Spark 2.1.0 offset format
{code}
{code}
[INFO] Reactor Summary for Spark Project Parent POM 3.0.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 4.178 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 9.373 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 24.586 s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 5.456 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 49.819 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 6.096 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 14.714 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 5.277 s]
[INFO] Spark Project Core ................................. SUCCESS [32:58 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 41.076 s]
[INFO] Spark Project GraphX ............................... SUCCESS [01:51 min]
[INFO] Spark Project Streaming ............................ SUCCESS [06:43 min]
[INFO] Spark Project Catalyst ............................. SUCCESS [15:04 min]
[INFO] Spark Project SQL .................................. SUCCESS [ 01:32 h]
[INFO] Spark Project ML Library ........................... SUCCESS [26:48 min]
[INFO] Spark Project Tools ................................ SUCCESS [ 7.830 s]
[INFO] Spark Project Hive ................................. SUCCESS [ 01:00 h]
[INFO] Spark Project Graph API ............................ SUCCESS [ 3.378 s]
[INFO] Spark Project Cypher ............................... SUCCESS [ 3.672 s]
[INFO] Spark Project Graph ................................ SUCCESS [ 3.615 s]
[INFO] Spark Project REPL ................................. SUCCESS [02:11 min]
[INFO] Spark Project Assembly ............................. SUCCESS [ 3.058 s]
[INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [ 24.208 s]
[INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:46 min]
[INFO] Kafka 0.10+ Source for Structured Streaming ........ FAILURE [06:15 min]
[INFO] Spark Project Examples ............................. SKIPPED
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [ 2.467 s]
[INFO] Spark Avro ......................................... SUCCESS [01:47 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 04:11 h
[INFO] Finished at: 2019-09-08T02:49:07-04:00
[INFO] ------------------------------------------------------------------------
{code}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org