You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 03:27:44 UTC
[I] [FIXED] EMR Presto cannot read Hudi tables saved to S3 [hudi]
hudi-bot opened a new issue, #14535:
URL: https://github.com/apache/hudi/issues/14535
Original issue: [https://github.com/apache/incubator-hudi/issues/1329]
Code I tried: [https://gist.github.com/popart/c16a4661528fe1819aa63a1fed351e0c,] based off of [https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hudi-work-with-dataset.html].
In AWS EMR 5.28.0 & 5.28.0, attempting to query a hudi table from Presto results in the error: Could not find partitionDepth in partition metafile. Querying from Spark or Hive works as expected.
This problem does not occur when using HDFS.
cc: [~bhasudha]
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-614
- Type: Bug
- Affects version(s):
- 0.5.0
- 0.5.1
---
## Comments
24/Feb/20 22:21;popart;Update: This problem does not occur in the docker environment. In the docker demo env, I was able to create a non-partitioned table in Spark (saved to hdfs), use run_sync_tool.sh to sync it to hive, and then query it successfully from presto. (It still made the .hoodie_partition_metadata file though).;;;
---
26/Feb/20 17:22;popart;I found the problem. We had client-side encryption configured for Spark & Hive using EMRFS, but not for Presto. Can close this issue.;;;
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [FIXED] EMR Presto cannot read Hudi tables saved to S3 [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #14535:
URL: https://github.com/apache/hudi/issues/14535#issuecomment-4795185329
Closing for inactivity. JIRA: [HUDI-614](https://issues.apache.org/jira/browse/HUDI-614). This issue has had no activity for over two years and the GitHub thread has no replies. If this is still relevant, please open a fresh issue with reproduction details on a recent release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [FIXED] EMR Presto cannot read Hudi tables saved to S3 [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #14535: [FIXED] EMR Presto cannot read Hudi tables saved to S3
URL: https://github.com/apache/hudi/issues/14535
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org