You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2025/01/14 15:04:36 UTC
[I] Run object_store tests (on CI) with WASM build/runtime [arrow-rs]
alamb opened a new issue, #6980:
URL: https://github.com/apache/arrow-rs/issues/6980
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
- Part of https://github.com/apache/arrow-rs/issues/6818
As we improve the story for using `object_store` with WASM we currently check that the code compiles with WASM, but have no coverage for actually running tests iina. WASM runtime to verify behavior. For example, as @XiangpengHao we have no way to verify support for files larger than 4GB (where WASM's 32-bit `usize` can be a problem):
- https://github.com/apache/arrow-rs/pull/6961
**Describe the solution you'd like**
I would like to run all relevant tests from object_store on a wasm runtime to ensure they actually run
**Describe alternatives you've considered**
I don't really know much about how this works, but I can imagine potentially using this crate:
https://github.com/bytecodealliance/wasmtime
Somehow to run the generated wasm
**Additional context**
<!--
Add any other context or screenshots about the feature request here.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Run object_store tests (on CI) with WASM build/runtime [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #6980:
URL: https://github.com/apache/arrow-rs/issues/6980#issuecomment-2590564959
@Xuanwo provided an example of how they do it in opendal: https://github.com/apache/opendal/blob/781682cc05b31d1f12f91fb7568a868f038c4d3b/.github/workflows/test_edge.yml#L62-L107
> > Thanks for the review @alamb , I agree with the rationale but unfortunately we don't yet have the infra to test wasm32 yet. We currently only build on wasm32, but there's no runner that can actually execute the webassembly
>
> OpenDAL has an edge test for this; it's worth taking a look.
>
> https://github.com/apache/opendal/blob/781682cc05b31d1f12f91fb7568a868f038c4d3b/.github/workflows/test_edge.yml#L62-L107
>
> The test code could be found here: https://github.com/apache/opendal/tree/main/core/edge/s3_read_on_wasm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Run object_store tests (on CI) with WASM build/runtime [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #6980:
URL: https://github.com/apache/arrow-rs/issues/6980#issuecomment-2741680377
Migrating from arrow-rs issue [#6980](https://github.com/apache/arrow-rs/issues/6980)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org