You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2026/04/28 04:31:01 UTC

[I] Add Vortex Spark datasource reader and wire into SparkAdapter [hudi]

yihua opened a new issue, #18629:
URL: https://github.com/apache/hudi/issues/18629

   ### Task Description
   
   **What needs to be done:**
   Implement `SparkVortexReaderBase` for query-time reading through `HoodieFileGroupReaderBasedFileFormat`. Add `createVortexFileReader()` to `SparkAdapter` trait and override in each Spark-version adapter (3.3-4.1). Wire `VORTEX` dispatch into `HoodieFileGroupReaderBasedFileFormat` and `MultipleColumnarFileFormatReader`.
   
   **Why this task is needed:**
   Enables end-to-end Spark SQL queries on Hudi tables backed by Vortex base files.
   
   ### Task Type
   
   Code improvement/refactoring
   
   ### Related Issues
   
   **Parent feature issue:** https://github.com/apache/hudi/issues/18623
   **Related issues:**
   NOTE: Use `Relationships` button to add parent/blocking issues after issue is created.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Add Vortex Spark datasource reader and wire into SparkAdapter [hudi]

Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on issue #18629:
URL: https://github.com/apache/hudi/issues/18629#issuecomment-4949851229

   Implemented on master via the #19182 squash-merge (commit 0fc240bf5f95).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Add Vortex Spark datasource reader and wire into SparkAdapter [hudi]

Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua closed issue #18629: Add Vortex Spark datasource reader and wire into SparkAdapter
URL: https://github.com/apache/hudi/issues/18629


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org