[GitHub] [hudi] nsivabalan commented on issue #4748: [SUPPORT] Question: Does "SINGLE_WRITER" also utilize if hoodie.write.lock.* is provided?

[GitBox <gi...@apache.org>]

nsivabalan commented on issue #4748:
URL: https://github.com/apache/hudi/issues/4748#issuecomment-1030873277


   you have to set concurrency.mode=optimistic_concurrency_control. more info can be found [here](https://hudi.apache.org/docs/0.8.0/concurrency_control/).
   
   if you set it to single writer, lock providers are not effective. 
   
   So, may be its an issue w/ metadata table. w/o enabling metadata, does your pipeline run smoothly w/o any issues? 
   Also, we have a command in hudi-cli in 0.10.1 or latest master "metadata validate-files" that you can try it out. It might give file mismatches between fs based listing and metadata based listing. 
   If you wish to rebuild metadata, you can delete the metadata from hudi-cli and your next write will bootstrap the metadata table again. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org