You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Harshal Patil (Jira)" <ji...@apache.org> on 2022/05/25 14:51:00 UTC

[jira] [Updated] (HUDI-4155) Support optional Source schema config for S3EventsHoodieIncrSource

     [ https://issues.apache.org/jira/browse/HUDI-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harshal Patil updated HUDI-4155:
--------------------------------
    Fix Version/s: 0.12.0

> Support optional Source schema config for S3EventsHoodieIncrSource
> ------------------------------------------------------------------
>
>                 Key: HUDI-4155
>                 URL: https://issues.apache.org/jira/browse/HUDI-4155
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: Harshal Patil
>            Assignee: Harshal Patil
>            Priority: Minor
>             Fix For: 0.12.0
>
>
> `S3EventsHoodieIncrSource`  does not support external optional schema but infers schema using spark . But there are use cases for optional fields to be added in dataframe reader to support transformers which are dependent on optional fields . 
> Also not necessary infer schema fits every requirement . 



--
This message was sent by Atlassian Jira
(v8.20.7#820007)