You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Raymond Xu (Jira)" <ji...@apache.org> on 2021/12/30 05:19:00 UTC
[jira] [Assigned] (HUDI-3131) Spark3.1.1 CTAS error
[ https://issues.apache.org/jira/browse/HUDI-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raymond Xu reassigned HUDI-3131:
--------------------------------
Assignee: Yann Byron
> Spark3.1.1 CTAS error
> ---------------------
>
> Key: HUDI-3131
> URL: https://issues.apache.org/jira/browse/HUDI-3131
> Project: Apache Hudi
> Issue Type: Bug
> Components: Spark Integration
> Reporter: Yann Byron
> Assignee: Yann Byron
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.11.0, 0.10.1
>
>
> Fail to run CTAS with Hudi0.10.0 and Spark3.1.1.
>
> Sql:
> {code:java}
> create table h1_p using hudi partitioned by(dt) options(type = 'cow', primaryKey = 'id') as select '2021-05-07' as dt, 1 as id, 'a1' as name, 10 as price; {code}
> Error:
> {code:java}
> java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.plans.logical.Command.producedAttributes$(Lorg/apache/spark/sql/catalyst/plans/logical/Command;)Lorg/apache/spark/sql/catalyst/expressions/AttributeSet;
> at org.apache.spark.sql.hudi.command.CreateHoodieTableAsSelectCommand.producedAttributes(CreateHoodieTableAsSelectCommand.scala:39) {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)