You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/12/07 20:44:00 UTC

[jira] [Created] (SPARK-26309) Verification of Data source options

Maxim Gekk created SPARK-26309:
----------------------------------

             Summary: Verification of Data source options
                 Key: SPARK-26309
                 URL: https://issues.apache.org/jira/browse/SPARK-26309
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.4.0
            Reporter: Maxim Gekk


Currently, applicability of datasource options passed to DataFrameReader and DataFrameWriter are not checked fully. For example, If an option is used only in write, it will be silently ignored in read. Such behavior of built-in datasource usually confuses users. The ticket aims to implement additional verification of datasource option and detect option misusing. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org