You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Raymond Xu (Jira)" <ji...@apache.org> on 2022/05/03 09:09:00 UTC

[jira] [Updated] (HUDI-3783) Fix HoodieTestTable harness to also properly validate Column Stats

     [ https://issues.apache.org/jira/browse/HUDI-3783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raymond Xu updated HUDI-3783:
-----------------------------
    Sprint: Hudi-Sprint-Apr-19, Hudi-Sprint-Apr-25, Hudi-Sprint-May-02  (was: Hudi-Sprint-Apr-19, Hudi-Sprint-Apr-25)

> Fix HoodieTestTable harness to also properly validate Column Stats
> ------------------------------------------------------------------
>
>                 Key: HUDI-3783
>                 URL: https://issues.apache.org/jira/browse/HUDI-3783
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Alexey Kudinkin
>            Priority: Blocker
>             Fix For: 0.11.1, 0.12.0
>
>
> Currently `HoodieTestTable` generates invalid tables which prevent effective testing of the Column Stats Index:
>  # It does write empty Parquet files, making impossible to construct proper ColStats records for these
>  # It does set phony Commit Metadata omitting Schema (for aforementioned reasons), which breaks ColStats when trying to update records during Rollbacks/Cleanings as CS relies on TableSchemaResolver, which is not able to resolve schema for an invalid table



--
This message was sent by Atlassian Jira
(v8.20.7#820007)