You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2023/02/02 13:26:00 UTC

[jira] [Assigned] (SPARK-42291) Allow drop column operation on non V2 tables

     [ https://issues.apache.org/jira/browse/SPARK-42291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-42291:
------------------------------------

    Assignee:     (was: Apache Spark)

> Allow drop column operation on non V2 tables
> --------------------------------------------
>
>                 Key: SPARK-42291
>                 URL: https://issues.apache.org/jira/browse/SPARK-42291
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 3.2.0
>         Environment: We're running Spark 3.2.0 with an external hive metastore; the underlying data is in parquet format in cloud storage.
>            Reporter: Yeachan Park
>            Priority: Minor
>
> Drop column operations do not seem to be supported outside of non-V2 tables: https://github.com/apache/spark/blob/5d45a415f3a29898d92380380cfd82bfc7f579ea/sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala#L93
> We have not been able to find a clear rationale as to why. It would be nice if this feature can be supported for none V2 tables. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org