You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "rangareddy (via GitHub)" <gi...@apache.org> on 2026/08/21 06:00:32 UTC
Re: [I] Support YYYY-MM-DD partition format with hive [hudi]
rangareddy commented on issue #17283:
URL: https://github.com/apache/hudi/issues/17283#issuecomment-5365813333
This issue was reviewed as part of the JIRA-migrated backlog triage (HUDI-8312).
**Findings: needs the reproduction run with a Hive metastore; not decidable from source.**
The report is specific - a custom keygen combining `SimpleKeyGenerator` with `TimestampBasedKeyGenerator` produces partition values formatted `YYYY-MM-DD`, and syncing those to Hive fails. The description carries a full Scala reproduction built on the `TestSparkSqlWithCustomKeyGenerator` helpers, which is enough to run directly.
Whether such a partition value round-trips through Hive depends on partition-path escaping and on how the synced Hive partition spec is constructed from the path - not something the source settles either way.
**This is almost certainly the same fix as #17282 (HUDI-8311)**, which reports the identical failure for the other separator. Suggest merging them, or at least fixing them together, since a solution that handles one separator and not the other would be arbitrary. Worth also checking the other common formats (`YYYYMMDD`, `YYYY-MM-DD-HH`) in the same pass so this does not recur one separator at a time.
Keeping this open.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org