You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "izchen (via GitHub)" <gi...@apache.org> on 2025/11/25 09:37:48 UTC
[I] [VL] Support native Avro scan [incubator-gluten]
izchen opened a new issue, #11178:
URL: https://github.com/apache/incubator-gluten/issues/11178
### Description
Adds a Velox-native Avro scan operator, significantly reducing serialization overhead.
Production workloads demonstrate **~80% improvement** in scan performance.
Will submit a Draft PR shortly and iterate on the implementation, work toward merging into Gluten and Velox main.
After:
<img width="626" height="606" alt="Image" src="https://github.com/user-attachments/assets/cb67540a-24f2-4911-96c6-c9fdd2bb8ecd" />
Before:
<img width="771" height="810" alt="Image" src="https://github.com/user-attachments/assets/28e21422-5fdb-49dc-a0f8-3a267d97bfdd" />
### Gluten version
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Support native Avro scan [incubator-gluten]
Posted by "izchen (via GitHub)" <gi...@apache.org>.
izchen commented on issue #11178:
URL: https://github.com/apache/incubator-gluten/issues/11178#issuecomment-3574767874
[velox patch](https://github.com/izchen/velox/commit/f4ab635d0d3b26845c63a8bd9ad41f0ba06bdb4d) (For preview only. Will submit a PR to facebookincubator/velox after further refinement)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Support native Avro scan [incubator-gluten]
Posted by "izchen (via GitHub)" <gi...@apache.org>.
izchen commented on issue #11178:
URL: https://github.com/apache/incubator-gluten/issues/11178#issuecomment-3669242594
https://github.com/facebookincubator/velox/pull/15790
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org