You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "nsivabalan (via GitHub)" <gi...@apache.org> on 2026/06/25 02:36:31 UTC

Re: [I] Support optional Source schema config for S3EventsHoodieIncrSource [hudi]

nsivabalan commented on issue #15199:
URL: https://github.com/apache/hudi/issues/15199#issuecomment-4795332871

   This appears to be addressed on current `master`. `S3EventsHoodieIncrSource` accepts an optional `SchemaProvider` via `StreamContext` (see `S3EventsHoodieIncrSource.java:108`) and threads it through `CloudDataFetcher.fetchPartitionedSource` to `CloudObjectsSelectorCommon.loadAsDataset`, where the user-supplied schema is applied to the Spark `DataFrameReader` via `reader.schema(rowSchema)` (`CloudObjectsSelectorCommon.java:288-298`). When no schema provider is configured, Spark inference is still used. This was implemented in commit df90640 ([HUDI-4115], PR #9502).
   
   If you can still reproduce the original issue on current master, please share a minimal config / repro and we'll re-open. Otherwise this can likely be closed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org