You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (Jira)" <ji...@apache.org> on 2022/10/11 06:43:00 UTC

[jira] [Resolved] (SPARK-40667) Refactor File Data Source Options

     [ https://issues.apache.org/jira/browse/SPARK-40667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wenchen Fan resolved SPARK-40667.
---------------------------------
    Fix Version/s: 3.4.0
       Resolution: Fixed

Issue resolved by pull request 38113
[https://github.com/apache/spark/pull/38113]

> Refactor File Data Source Options
> ---------------------------------
>
>                 Key: SPARK-40667
>                 URL: https://issues.apache.org/jira/browse/SPARK-40667
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.4.0
>            Reporter: Xiaonan Yang
>            Assignee: Xiaonan Yang
>            Priority: Major
>             Fix For: 3.4.0
>
>
> Currently for each file data source, all options are placed sparsely in the options class and there is no clear list of all options supported. As more and more options are added, the readability gets worse. Thus, we want to refactor those codes so that
>  # we can easily get a list of supported options for each data source
>  # enforce better practice for adding new options going forwards.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org