You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 11:30:58 UTC
[I] Doc update on implicit lock provider [hudi]
hudi-bot opened a new issue, #16814:
URL: https://github.com/apache/hudi/issues/16814
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8964
- Type: Task
- Fix version(s):
- 1.1.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Doc update on implicit lock provider [hudi]
Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #16814:
URL: https://github.com/apache/hudi/issues/16814#issuecomment-5057234029
This issue was reviewed as part of the JIRA-migrated backlog triage.
This is a documentation task (HUDI-8964), not a bug. As of today the concurrency-control docs (https://hudi.apache.org/docs/concurrency_control#distributed-locking) document the Storage-based, ZooKeeper, HiveMetastore, DynamoDB, and FileSystem lock providers, but do not yet cover the implicit partition-key DynamoDB lock provider (DynamoDBBasedImplicitPartitionKeyLockProvider).
The doc update is still pending. Keeping open as an incomplete docs task.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Doc update on implicit lock provider [hudi]
Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #16814:
URL: https://github.com/apache/hudi/issues/16814#issuecomment-5391601898
**Findings: the documentation has since been updated. This can be closed.**
An earlier note on this issue (July 2026) recorded that the concurrency-control docs covered the Storage-based, ZooKeeper, HiveMetastore, DynamoDB and FileSystem lock providers but not the implicit-partition-key variant. That is no longer the case.
[docs/concurrency_control#distributed-locking](https://hudi.apache.org/docs/concurrency_control#distributed-locking) now documents six providers, including **"DynamoDB-Based Lock Provider with Implicit Partition Key"**, and explains the mechanism:
> Rather than reading `hoodie.write.lock.dynamodb.partition_key`, it derives the key from the table's base path: the 64-bit xxHash of that path.
along with the rationale - two tables sharing a name under different paths would otherwise resolve to the same lock and serialize writers that never touch the same data, so deriving the key from the base path keeps it unique per table with no per-table configuration.
That covers what this ticket asked for. The implementation it documents is `hudi-aws/src/main/java/org/apache/hudi/aws/transaction/lock/DynamoDBBasedImplicitPartitionKeyLockProvider.java`, with configuration in `HoodieLockConfig`.
Closing as done. Worth resolving JIRA HUDI-8964 to match.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Doc update on implicit lock provider [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on issue #16814:
URL: https://github.com/apache/hudi/issues/16814#issuecomment-3652352505
@xushiyan @Davis-Zhang-Onehouse the docs of lock providers need to be updated: https://hudi.apache.org/docs/concurrency_control#distributed-locking
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Doc update on implicit lock provider [hudi]
Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy closed issue #16814: Doc update on implicit lock provider
URL: https://github.com/apache/hudi/issues/16814
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org