You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 03:21:57 UTC

[I] Automatically infer the data directory, users only need to specify the table directory [hudi]

hudi-bot opened a new issue, #14439:
URL: https://github.com/apache/hudi/issues/14439

   To read the hudi table, you need to specify the path, but the path is not only the tablePath corresponding to the table, but needs to be determined by the partition directory structure. Different keyGenerators correspond to different partition directory structures. The first-level partition directory uses path=.../table/*/*, the secondary partition directory path=../table/*/*/*
   
   so it is troublesome to let the user specify the data path, the user only needs to specify the tablePath:  .../table
    
    
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-1527
   - Type: Improvement
   
   
   ---
   
   
   ## Comments
   
   12/Mar/22 14:18;xushiyan;[~rmahindra] what is the next step for this ticket? i saw the PR was closed. https://github.com/apache/hudi/pull/3353;;;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Automatically infer the data directory, users only need to specify the table directory [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #14439:
URL: https://github.com/apache/hudi/issues/14439#issuecomment-4795159762

   This appears to already be addressed on current master. Non-globbed table-path queries were introduced via [HUDI-1591](https://issues.apache.org/jira/browse/HUDI-1591) (PR #2651) which added `HoodieFileIndex` so the Spark datasource can discover partitions automatically from just the table path. More recently, PR #14060 (commit `2ebc6775dbb6`, merged 2025-11-24) removed glob path support from the Spark datasource entirely — users now specify only the table path (e.g. `spark.read.format("hudi").load("/path/to/table")`) regardless of partition depth or key generator. Could you confirm on current master and close this if no longer reproducible?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Automatically infer the data directory, users only need to specify the table directory [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #14439:
URL: https://github.com/apache/hudi/issues/14439#issuecomment-3630149408

   ### Linked PR(s)
   
   - https://github.com/apache/hudi/pull/2475
   - https://github.com/apache/hudi/pull/3353


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Automatically infer the data directory, users only need to specify the table directory [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #14439: Automatically infer the data directory, users only need to specify the table directory
URL: https://github.com/apache/hudi/issues/14439


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org