You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jon LaFlamme (Jira)" <ji...@apache.org> on 2021/07/19 16:29:00 UTC

[jira] [Created] (SPARK-36212) Add exception for Kafka readstream when decryption fails

Jon LaFlamme created SPARK-36212:
------------------------------------

             Summary: Add exception for Kafka readstream when decryption fails
                 Key: SPARK-36212
                 URL: https://issues.apache.org/jira/browse/SPARK-36212
             Project: Spark
          Issue Type: Task
          Components: Structured Streaming
    Affects Versions: 3.0.0
         Environment: Spark 3.0.0
            Reporter: Jon LaFlamme
             Fix For: 3.1.0


A silent failure is possible when reading from a Kafka broker under the following circumstances:

SDF.isStreaming = True

SDF.printSchema() => returns expected schema

Query results are empty.

Issue: Tsl Decryption has failed, but there is no exception or warning.

Request: Add a warning throw an exception when decryption fails, such that developers can efficiently diagnose the readstream problem.

 

This is my first ticket submitted. Please notify me if I should change anything in this ticket to make it more conformant to community standards. I'm still a beginner with Spark.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org