You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/12/19 06:49:20 UTC

[GitHub] [hudi] nsivabalan edited a comment on issue #2498: [SUPPORT] Hudi MERGE_ON_READ load to dataframe fails for the versions [0.6.0],[0.7.0] and runs for [0.5.3]

nsivabalan edited a comment on issue #2498:
URL: https://github.com/apache/hudi/issues/2498#issuecomment-997339302


   For `NoSuchMethodError: org.apache.spark.sql.execution.datasources.PartitionedFile.<init>`, please refer to https://github.com/apache/hudi/issues/2498#issuecomment-969228521 for the proposed fix. You have to provide the jars explicitly in class path or add it to spark/jars dir.
   
   We had issues w/ EMR version of spark and after copying spark-sql jar to spark/jars directory, able to resolve it. we don't face this issue when we use open source spark. Its an issue only with emr spark. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org