You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "milenkovicm (via GitHub)" <gi...@apache.org> on 2025/02/27 12:33:25 UTC
[I] Consider using `with_skip_validation` for shuffle file reading [datafusion-ballista]
milenkovicm opened a new issue, #1189:
URL: https://github.com/apache/datafusion-ballista/issues/1189
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
Improve shuffle reading, with https://github.com/apache/arrow-rs/pull/7120 merged consider using it for shuffle files.
**Describe the solution you'd like**
Change shuffle reader to utilise new api.
**Describe alternatives you've considered**
Keep everything as it is
**Additional context**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Consider using `with_skip_validation` for shuffle file reading [datafusion-ballista]
Posted by "westhide (via GitHub)" <gi...@apache.org>.
westhide commented on issue #1189:
URL: https://github.com/apache/datafusion-ballista/issues/1189#issuecomment-2761293050
/take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Consider using `with_skip_validation` for shuffle file reading [datafusion-ballista]
Posted by "westhide (via GitHub)" <gi...@apache.org>.
westhide commented on issue #1189:
URL: https://github.com/apache/datafusion-ballista/issues/1189#issuecomment-2761307615
References:
[Benchmarks for Arrow IPC reader](https://github.com/apache/arrow-rs/pull/7091)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Consider using `with_skip_validation` for shuffle file reading [datafusion-ballista]
Posted by "killzoner (via GitHub)" <gi...@apache.org>.
killzoner commented on issue #1189:
URL: https://github.com/apache/datafusion-ballista/issues/1189#issuecomment-3774470549
I will have a look at https://github.com/apache/datafusion-ballista/issues/1316#issuecomment-3279895972 in the following weeks if that's still relevant
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Consider using `with_skip_validation` for shuffle file reading [datafusion-ballista]
Posted by "milenkovicm (via GitHub)" <gi...@apache.org>.
milenkovicm closed issue #1189: Consider using `with_skip_validation` for shuffle file reading
URL: https://github.com/apache/datafusion-ballista/issues/1189
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org