[jira] [Closed] (HUDI-3290) Make the .hoodie-partition-metadata as empty parquet file

["Raymond Xu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raymond Xu closed HUDI-3290.
----------------------------
    Resolution: Done

> Make the .hoodie-partition-metadata as empty parquet file
> ---------------------------------------------------------
>
>                 Key: HUDI-3290
>                 URL: https://issues.apache.org/jira/browse/HUDI-3290
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: metadata
>            Reporter: Vinoth Govindarajan
>            Assignee: Prashant Wason
>            Priority: Blocker
>              Labels: pull-request-available, user-support-issues
>             Fix For: 0.11.0
>
>
> For BigQuery and Snowflake integration, we can't able to create external tables when the partition folder has a non-parquet file `.hoodie-partition-metadata`.
> I understand this is an important file to find the .hoodie folder from within the partition folder, the long term solution is to get rid of this file, but as a short term solution if we can convert this to an empty parquet file and add the necessary depth information in the footer, then it will pass the BigQuery/Snowflake external table validation and allow us to create an external parquet table on top of hudi folder structure.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)