You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 09:36:39 UTC
[I] HoodieTableMetaClient need support a config to user for whether to checkTableValidity [hudi]
hudi-bot opened a new issue, #16371:
URL: https://github.com/apache/hudi/issues/16371
HoodieTableMetaClient need support a config to user for whether to checkTableValidity avoid large numebr of file listing: currently user would had a large number of list rpc requet to hdfs due to HoodieTableMetaClient be called create，TableNotFoundException#checkTableValidity would cause so much list rpc request to namenode, add a config for user to decide whether enable it，default is true.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7318
- Type: Improvement
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] HoodieTableMetaClient need support a config to user for whether to checkTableValidity [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #16371:
URL: https://github.com/apache/hudi/issues/16371#issuecomment-3630277309
### Linked PR(s)
- https://github.com/apache/hudi/pull/10546
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] HoodieTableMetaClient need support a config to user for whether to checkTableValidity [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #16371: HoodieTableMetaClient need support a config to user for whether to checkTableValidity
URL: https://github.com/apache/hudi/issues/16371
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] HoodieTableMetaClient need support a config to user for whether to checkTableValidity [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #16371:
URL: https://github.com/apache/hudi/issues/16371#issuecomment-4795595766
This appears to already be addressed on master. [HUDI-8331](https://issues.apache.org/jira/browse/HUDI-8331) / PR [#12078](https://github.com/apache/hudi/pull/12078) (commit `9e65cb405d`, merged Oct 2024) removed the eager `TableNotFoundException.checkTableValidity(...)` call from `HoodieTableMetaClient`'s constructor — eliminating the per-instantiation `getPathInfo(metaPath)` listing RPC that this issue describes. The validity check is now lazy: a `TableNotFoundException` is only thrown from `ConfigUtils` when reading `hoodie.properties` fails AND `metaPath` doesn't exist, which is on the existing read path and not an extra RPC. Could you confirm whether you're hitting this on a release that contains the fix? If yes, please share the call stack / Hudi version; otherwise this can likely be closed as resolved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org