You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2020/09/16 20:40:00 UTC

[jira] [Commented] (SPARK-28396) Add PathCatalog for data source V2

    [ https://issues.apache.org/jira/browse/SPARK-28396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197225#comment-17197225 ] 

Dongjoon Hyun commented on SPARK-28396:
---------------------------------------

Hi, [~Gengliang.Wang] This is closed as 'Won't Fix'. So, there is no future plan even in Apache Spark 3.1.0?

Also, cc [~cloud_fan] and [~smilegator]

> Add PathCatalog for data source V2
> ----------------------------------
>
>                 Key: SPARK-28396
>                 URL: https://issues.apache.org/jira/browse/SPARK-28396
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Gengliang Wang
>            Priority: Major
>
> Add PathCatalog for data source V2, so that:
> 1. We can convert SaveMode in DataFrameWriter into catalog table operations, instead of supporting SaveMode in file source V2.
> 2. Support create-table SQL statements like "CREATE TABLE orc.'path'"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org