You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Zheren Yu (Jira)" <ji...@apache.org> on 2020/09/07 02:15:00 UTC
[jira] [Commented] (HUDI-1270) NoSuchMethod PartitionedFile on AWS
EMR Spark 2.4.5
[ https://issues.apache.org/jira/browse/HUDI-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17191405#comment-17191405 ]
Zheren Yu commented on HUDI-1270:
---------------------------------
I also meet this problem, it's because org.apache.spark.sql.execution.datasources.PartitionedFile on emr have different implementation
https://github.com/apache/hudi/issues/2041
> NoSuchMethod PartitionedFile on AWS EMR Spark 2.4.5
> ---------------------------------------------------
>
> Key: HUDI-1270
> URL: https://issues.apache.org/jira/browse/HUDI-1270
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Gary Li
> Priority: Major
>
> There are some AWS EMR users reporting:
> java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.PartitionedFile.
> on EMR (Spark-2.4.5-amzn-0) when using the Spark Datasource to query MOR table.
> [https://github.com/apache/hudi/pull/1848#issuecomment-687392285]
> [https://github.com/apache/hudi/issues/2057#issuecomment-685015564]
> [~uditme] [~vbalaji] would you guys able to help?
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)