You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 03:28:47 UTC

[I] Improve deltastreamer error message when case mismatch of commandline arguments. [hudi]

hudi-bot opened a new issue, #14553:
URL: https://github.com/apache/hudi/issues/14553

   Team,
   
   When following the blog "Change Capture Using AWS Database Migration
   Service and Hudi" with my own data set, the initial load works perfectly.
   When issuing the command with the DMS CDC files on S3, I get the following
   error:
   
   {code}
   20/03/24 17:56:28 ERROR HoodieDeltaStreamer: Got error running delta sync
   once. Shutting down
   org.apache.hudi.exception.HoodieException: Please provide a valid schema
   provider class! at
   org.apache.hudi.utilities.sources.InputBatch.getSchemaProvider(InputBatch.java:53)
    at
   org.apache.hudi.utilities.deltastreamer.DeltaSync.readFromSource(DeltaSync.java:312)
   at
   org.apache.hudi.utilities.deltastreamer.DeltaSync.syncOnce(DeltaSync.java:226)
   {code}
   
   I tried using the  --schemaprovider-class
   org.apache.hudi.utilities.schema.FilebasedSchemaProvider.Source and provide
   the schema. The error does not occur but there are no write to Hudi.
   
   I am not performing any transformations (other than the DMS transform) and
   using default record key strategy.
   
   If the team has any pointers, please let me know.
   
   Thank you!
   
   ---
   
   
   Thank you Vinoth. I was able to find the issue. All my column names were in
   high caps case. I switched column names and table names to lower case and
   it works perfectly.
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-735
   - Type: Improvement
   
   
   ---
   
   
   ## Comments
   
   23/May/20 21:31;shivnarayan;[~nicholasjiang]: did you get a chance to work on it. If you have any PR, do update the jira. ;;;
   
   ---
   
   11/Sep/20 08:51;Pratyaksh;Anything else needs to be done here? As per the description of this Jira, guess we can close this? [~vinoth];;;
   
   ---
   
   13/Dec/21 21:02;shivnarayan;[~nicholasjiang] : Sorry, is it just the error msg is not very apt or are you running into any issues as such. if you don't mind, can you clarify please. ;;;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Improve deltastreamer error message when case mismatch of commandline arguments. [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #14553: Improve deltastreamer error message when case mismatch of commandline arguments.
URL: https://github.com/apache/hudi/issues/14553


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Improve deltastreamer error message when case mismatch of commandline arguments. [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #14553:
URL: https://github.com/apache/hudi/issues/14553#issuecomment-3630174985

   ### Linked PR(s)
   
   - https://github.com/apache/hudi/pull/4342


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Improve deltastreamer error message when case mismatch of commandline arguments. [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #14553:
URL: https://github.com/apache/hudi/issues/14553#issuecomment-4795188625

   This appears to be addressed on master. The cryptic `Please provide a valid schema provider class!` error was replaced with a much more actionable message in commit [`17a7a6fa`](https://github.com/apache/hudi/commit/17a7a6faf89a58a5bf73b8fba9752d2a633b8e97) (PR #14115). The current message in [`InputBatch.getSchemaProvider()`](https://github.com/apache/hudi/blob/master/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/InputBatch.java#L55-L65) names the `--schemaprovider-class` flag explicitly, clarifies it must be set at the top-level HoodieStreamer config, and gives a concrete example with `SchemaRegistryProvider` and `hoodie.streamer.schemaprovider.registry.url`. Closing as fixed — please reopen if you still see the original message on a recent release.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org