[jira] [Created] (HUDI-8853) Spark sql ALTER TABLE queries are failing on EMR

["Mansi Patel (Jira)" <ji...@apache.org>]

Mansi Patel created HUDI-8853:
---------------------------------

             Summary: Spark sql ALTER TABLE queries are failing on EMR
                 Key: HUDI-8853
                 URL: https://issues.apache.org/jira/browse/HUDI-8853
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Mansi Patel


Some of the spark sql DDL queries are failing on EMR. Failed queries are listed here
1. ALTER TABLE DROP COLUMN

2. ALTER TABLE REPLACE COLUMN

3. ALTER TABLE RENAME COLUMN

 

 
{code:java}
scala> spark.sql("ALTER TABLE mansipp_hudi_fgac_table DROP COLUMN creation_date"); org.apache.spark.sql.AnalysisException: [UNSUPPORTED_FEATURE.TABLE_OPERATION] The feature is not supported: Table `spark_catalog`.`default`.`mansipp_hudi_fgac_table` does not support DROP COLUMN. Please check the current catalog and namespace to make sure the qualified table name is expected, and also check the catalog implementation which is configured by "spark.sql.catalog". at org.apache.spark.sql.errors.QueryCompilationErrors$.unsupportedTableOperationError(QueryCompilationErrors.scala:847) at org.apache.spark.sql.errors.QueryCompilationErrors$.unsupportedTableOperationError(QueryCompilationErrors.scala:837) at org.apache.spark.sql.catalyst.analysis.ResolveSessionCatalog$$anonfun$apply$1.applyOrElse(ResolveSessionCatalog.scala:110)
{code}
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)