[jira] [Commented] (SPARK-42291) Allow drop column operation on non V2 tables

["Yeachan Park (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-42291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683411#comment-17683411 ] 

Yeachan Park commented on SPARK-42291:
--------------------------------------

Created a PR: https://github.com/apache/spark/pull/39861

Would be good if someone can review/advise why this operation is not supported originally.

> Allow drop column operation on non V2 tables
> --------------------------------------------
>
>                 Key: SPARK-42291
>                 URL: https://issues.apache.org/jira/browse/SPARK-42291
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 3.2.0
>         Environment: We're running Spark 3.2.0 with an external hive metastore; the underlying data is in parquet format in cloud storage.
>            Reporter: Yeachan Park
>            Priority: Minor
>
> Drop column operations do not seem to be supported outside of non-V2 tables: https://github.com/apache/spark/blob/5d45a415f3a29898d92380380cfd82bfc7f579ea/sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala#L93
> We have not been able to find a clear rationale as to why. It would be nice if this feature can be supported for none V2 tables. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org