You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Harshal Patil (Jira)" <ji...@apache.org> on 2022/05/25 14:49:00 UTC

[jira] [Created] (HUDI-4155) Support optional Source schema config for S3EventsHoodieIncrSource

Harshal Patil created HUDI-4155:
-----------------------------------

             Summary: Support optional Source schema config for S3EventsHoodieIncrSource
                 Key: HUDI-4155
                 URL: https://issues.apache.org/jira/browse/HUDI-4155
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Harshal Patil


`S3EventsHoodieIncrSource`  does not support external optional schema but infers schema using spark . But there are use cases for optional fields to be added in dataframe reader to support transformers which are dependent on optional fields . 
Also not necessary infer schema fits every requirement . 



--
This message was sent by Atlassian Jira
(v8.20.7#820007)