You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Govindarajan (Jira)" <ji...@apache.org> on 2022/01/21 06:25:00 UTC
[jira] [Created] (HUDI-3290) Make the .hoodie-partition-metadata as empty parquet file
Vinoth Govindarajan created HUDI-3290:
-----------------------------------------
Summary: Make the .hoodie-partition-metadata as empty parquet file
Key: HUDI-3290
URL: https://issues.apache.org/jira/browse/HUDI-3290
Project: Apache Hudi
Issue Type: New Feature
Components: metadata
Reporter: Vinoth Govindarajan
Assignee: Vinoth Govindarajan
For BigQuery and Snowflake integration, we can't able to create external tables when the partition folder has a non-parquet file `.hoodie-partition-metadata`.
I understand this is an important file to find the .hoodie folder from within the partition folder, the long term solution is to get rid of this file, but as a short term solution if we can convert this to an empty parquet file and add the necessary depth information in the footer, then it will pass the BigQuery/Snowflake external table validation and allow us to create an external parquet table on top of hudi folder structure.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)