[GitHub] [hudi] xushiyan commented on issue #3191: [SUPPORT]client spark-submit cmd error:Caused by: java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.DataSourceUtils$.PARTITIONING_COLUMNS_KEY()Ljava/lang/String;

[GitBox <gi...@apache.org>]

xushiyan commented on issue #3191:
URL: https://github.com/apache/hudi/issues/3191#issuecomment-950416601


   @xer001 `PARTITIONING_COLUMNS_KEY` is **not** added in spark 2.4.0 see https://jar-download.com/artifacts/org.apache.spark/spark-sql_2.11/2.4.0/source-code/org/apache/spark/sql/execution/datasources/DataSourceUtils.scala
   It was added in 2.4.2 and later
   Can you please upgrade your spark to newer versions of `2.4.x` ?
   
   @mdz-doit `PARTITIONING_COLUMNS_KEY` **is** there in 2.4.5 see https://jar-download.com/artifacts/org.apache.spark/spark-sql_2.11/2.4.5/source-code/org/apache/spark/sql/execution/datasources/DataSourceUtils.scala
   
   Can you print your spark version from spark shell to make sure you have the right one? Or do you have other dependencies on your classpath? you can print the whole path to inspect.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org