You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2022/09/16 16:45:00 UTC

[jira] [Commented] (SPARK-40466) Improve the error message if the DSv2 source is disabled but DSv1 streaming source is not available

    [ https://issues.apache.org/jira/browse/SPARK-40466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17605921#comment-17605921 ] 

Apache Spark commented on SPARK-40466:
--------------------------------------

User 'huanliwang-db' has created a pull request for this issue:
https://github.com/apache/spark/pull/37917

> Improve the error message if the DSv2 source is disabled but DSv1 streaming source is not available
> ---------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-40466
>                 URL: https://issues.apache.org/jira/browse/SPARK-40466
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 3.4.0
>            Reporter: Huanli Wang
>            Priority: Minor
>
> If the V2 data source is disabled, current behavior will fallback to use V1 data source. But it will throw error when the DSv1 is not available. Update the error message to indicate what config variable (spark.sql.streaming.disabledV2MicroBatchReaders) needs to be modified in order to enable the V2 data source.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org