[jira] [Updated] (HUDI-8634) Support schema on read in file group reader-based compaction

["Y Ethan Guo (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Y Ethan Guo updated HUDI-8634:
------------------------------
    Status: In Progress  (was: Open)

> Support schema on read in file group reader-based compaction
> ------------------------------------------------------------
>
>                 Key: HUDI-8634
>                 URL: https://issues.apache.org/jira/browse/HUDI-8634
>             Project: Apache Hudi
>          Issue Type: Sub-task
>            Reporter: Y Ethan Guo
>            Priority: Blocker
>             Fix For: 1.0.1
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> Right now we disable the file group reader-based compaction for schema on read (see below code in HoodieCompactor). For example, this test fails if we enable the file group reader-based compaction for schema on read and remove the check `StringUtils.isNullOrEmpty(config.getInternalSchema())`: `Test alter column types`
> {code:java}
> boolean useFileGroupReaderBasedCompaction = !metaClient.isMetadataTable()
>     && config.getBooleanOrDefault(HoodieReaderConfig.FILE_GROUP_READER_ENABLED)
>     && compactionHandler.supportsFileGroupReader()
>     && !hasBootstrapFile(operations)
>     && StringUtils.isNullOrEmpty(config.getInternalSchema()); {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)