You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/04/26 12:47:27 UTC

[GitHub] [arrow-rs] alamb opened a new issue #180: Parquet does not support wasm32-unknown-unknown target

alamb opened a new issue #180:
URL: https://github.com/apache/arrow-rs/issues/180


   *Note*: migrated from original JIRA: https://issues.apache.org/jira/browse/ARROW-11593
   
   The Arrow crate successfully compiles to WebAssembly (e.g. https://github.com/domoritz/arrow-wasm) but the Parquet crate currently does not support the`wasm32-unknown-unknown` target. 
   
   Try out the repository at https://github.com/domoritz/parquet-wasm/commit/e877f9ad9c45c09f73d98fab2a8ad384a802b2e0. The problem seems to be in liblz4, even if I do not include lz4 in the feature flags.  


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] kylebarron edited a comment on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
kylebarron edited a comment on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1058827130


   Another update on the compression codecs:
   
   - [x] Uncompressed
   - [x] Snappy: works out of the box with `snap` feature
   - [x] Gzip: works out of the box with the `flate2` feature
   - [x] Brotli: works out of the box with the `brotli` feature. (I thought this had failed for me before, so maybe it was [updating my llvm/clang](https://github.com/kylebarron/parquet-wasm/pull/2) while debugging ZSTD that caused this to work).
   - [x] ZSTD: works with [this unreleased commit](https://github.com/gyscos/zstd-rs/commit/d6bfa32d09b8e4ef747c9b57109974c270ffab72) on `zstd-rs`, merged in January 2022, a day after the `0.10.0` release was cut πŸ₯² . Tested working when pointing to the latest `zstd-rs` master and with `default-features = false`. Hopefully they make a new release soon.
   - [ ] LZ4: The currently used [`lz4-rs`](https://github.com/10XGenomics/lz4-rs) hasn't had a release since June 8, 2020. It accepted a PR from July 2020 that [purported to add support for `wasm32-unknown-unknown`](https://github.com/10XGenomics/lz4-rs/pull/11) but I pulled their repo and couldn't get it to build for that target.
   
   	[`lz4-flex`](https://github.com/PSeitz/lz4_flex) successfully compiles to WASM, but the API is slightly different. I tried (https://github.com/kylebarron/arrow-rs/pull/3/files#diff-73978efa44253b6c1cafc48e0fd042b761ebfff35cb32c9f53717d1641dab0fe) to update `parquet/src/compression.rs` to the `lz4-flex` API. It compiles fine but I get panics when testing the WASM with an LZ4 parquet file in the browser. I don't really know what I'm doing wrong πŸ˜… . Switching out to `lz4-flex` seems very achievable by someone who knows Rust better than I do πŸ˜„ .
   - [ ] LZO: I see references to LZO compression in `parquet/src/basic.rs` but it doesn't seem to be implemented in `parquet/src/compression.rs`? I hadn't heard of LZO before. According to Wes, [LZO isn't really used anymore](https://github.com/apache/arrow/issues/2209#issuecomment-402859258), so I don't see myself working on this.
   
   In terms of Arrow IPC files being malformatted, I switched from `arrow::ipc::writer::StreamWriter` to `arrow::ipc::writer::FileWriter`. Now all the Arrow files generated by `parquet-wasm` from my Parquet test files are readable in _Python_ using `pa.ipc.open_file`, so presumably the JS errors arising from `arrow.tableFromIPC(tableBytes)` are issues with the JS library and its IPC parser. (It looks like there are known issues with the IPC support in JS [ARROW-15642](https://issues.apache.org/jira/browse/ARROW-15642), [ARROW-13818](https://issues.apache.org/jira/browse/ARROW-13818), [ARROW-8674](https://issues.apache.org/jira/browse/ARROW-8674))


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] domoritz commented on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
domoritz commented on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-990122878


   I think someone needs to go through the dependencies and replace them with ones that work in wasm. I think this is pretty doable. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] kylebarron commented on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
kylebarron commented on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1001102938


   In the original issue you mentioned
   
   > The problem seems to be in liblz4, even if I do not include lz4 in the feature flags.
   
   Testing locally it appears that both the `arrow` (v6.4.0) and `arrow2/parquet2` (v0.8.1) crates compile fine to wasm (using `wasm-pack build`) as long as I avoid both lz4 and zstd dependencies. My goal is to first get a working Parquet -> Arrow reader working in wasm, and then circle back to evaluate new lz4 and zstd implementations. But for now I'm still muddling through Rust πŸ˜… .


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] alamb commented on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-826807095


   Comment from Dominik Moritz(domoritz) @ 2021-02-12T21:59:13.949+0000:
   <pre>If lz4 is the issue, maybe we could switch to https://github.com/PSeitz/lz4_flex, which compiles to WASM. </pre>
   
   Comment from Andy Redhead(AndyRedhead1974) @ 2021-03-04T21:51:18.454+0000:
   <pre>A WebAssembly compatible Rust library that can read data from Parquet files would be very useful to anyone who would like to do "browser based" data processing/visualisation (better still if that library is in a family that includes efficient in-memory "data structures").Β </pre>
   
   Comment from David Roher(droher) @ 2021-04-12T02:03:38.512+0000:
   <pre>I just got a version of DataFusion working on wasm32-unknown-unknown – it required disabling both the LZ4 and ZSTD features on Parquet and tweaking the hash function: [https://github.com/apache/arrow/compare/master...droher:master]
   
   To add toΒ [~AndyRedhead1974]'s point above, it would also be useful in a serverless context – for instance, Cloudflare Workers Unbound is in beta now and will allow WASM functions to run at unlimited CPU usage. in this context, DataFusion could be a serverless data lake engine like AWS Athena. Maybe it could even be useful as a Ballista worker.</pre>
   
   Comment from Dominik Moritz(domoritz) @ 2021-04-12T04:38:44.388+0000:
   <pre>That's awesome. Do you want to add a note to https://issues.apache.org/jira/projects/ARROW/issues/ARROW-11615, which tracks DataFusion support for wasm?</pre>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] alamb commented on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1059769108


   Thank you for the update @kylebarron 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] kylebarron edited a comment on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
kylebarron edited a comment on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1058827130


   Another update on the compression codecs:
   
   - [x] Uncompressed
   - [x] Snappy: works out of the box with `snap` feature
   - [x] Gzip: works out of the box with the `flate2` feature
   - [x] Brotli: works out of the box with the `brotli` feature. (I thought this had failed for me before, so maybe it was [updating my llvm/clang](https://github.com/kylebarron/parquet-wasm/pull/2) while debugging ZSTD that caused this to work).
   - [x] ZSTD: works with [this unreleased commit](https://github.com/gyscos/zstd-rs/commit/d6bfa32d09b8e4ef747c9b57109974c270ffab72) on `zstd-rs`, merged in January 2022, a day after the `0.10.0` release was cut πŸ₯² . Tested working when pointing to the latest `zstd-rs` master and with `default-features = false`. Hopefully they make a new release soon.
   - [ ] LZ4: The currently used [`lz4-rs`](https://github.com/10XGenomics/lz4-rs) hasn't had a release since June 8, 2020. It accepted a PR from July 2020 that [purported to add support for `wasm32-unknown-unknown`](https://github.com/10XGenomics/lz4-rs/pull/11) but I pulled their repo and couldn't get it to build for that target.
   
   	[`lz4-flex`](https://github.com/PSeitz/lz4_flex) successfully compiles to WASM, but the API is slightly different. I tried (https://github.com/kylebarron/arrow-rs/pull/3/files#diff-73978efa44253b6c1cafc48e0fd042b761ebfff35cb32c9f53717d1641dab0fe) to update `parquet/src/compression.rs` to the `lz4-flex` API. It compiles fine but I get panics when testing the WASM with an LZ4 parquet file in the browser. I don't really know what I'm doing wrong πŸ˜… . Switching out to `lz4-flex` seems very achievable by someone who knows Rust better than I do πŸ˜„ .
   - [ ] LZO: I see references to LZO compression in `parquet/src/basic.rs` but it doesn't seem to be implemented in `parquet/src/compression.rs`? I hadn't heard of LZO before. According to Wes, [LZO isn't really used anymore](https://github.com/apache/arrow/issues/2209#issuecomment-402859258), so I don't see myself working on this.
   
   In terms of Arrow IPC files being malformatted, I switched from `arrow::ipc::writer::StreamWriter` to `arrow::ipc::writer::FileWriter`. Now all the Arrow files generated by `parquet-wasm` from my Parquet test files are readable in _Python_ using `pa.ipc.open_file`, so presumably the JS errors arising from `arrow.tableFromIPC(tableBytes)` are issues with the JS library and its IPC parser. (It looks like there are known issues with the IPC support in JS https://issues.apache.org/jira/browse/ARROW-15642, https://issues.apache.org/jira/browse/ARROW-13818, https://issues.apache.org/jira/browse/ARROW-8674)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] kylebarron edited a comment on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
kylebarron edited a comment on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1058827130


   Another update on the compression codecs:
   
   - [x] Uncompressed
   - [x] Snappy: works out of the box with `snap` feature
   - [x] Gzip: works out of the box with the `flate2` feature
   - [x] Brotli: works out of the box with the `brotli` feature. (I thought this had failed for me before, so maybe it was [updating my llvm/clang](https://github.com/kylebarron/parquet-wasm/pull/2) while debugging ZSTD that caused this to work).
   - [x] ZSTD: works with [this unreleased commit](https://github.com/gyscos/zstd-rs/commit/d6bfa32d09b8e4ef747c9b57109974c270ffab72) on `zstd-rs`, merged in January 2022, a day after the `0.10.0` release was cut πŸ₯² . Tested working when pointing to the latest `zstd-rs` master and with `default-features = false`. Hopefully they make a new release soon.
   - [ ] LZ4: The currently used [`lz4-rs`](https://github.com/10XGenomics/lz4-rs) hasn't had a release since June 8, 2020. It accepted a PR from July 2020 that [purported to add support for `wasm32-unknown-unknown`](https://github.com/10XGenomics/lz4-rs/pull/11) but I pulled their repo and couldn't get it to build for that target.
   
   	[`lz4-flex`](https://github.com/PSeitz/lz4_flex) successfully compiles to WASM, but the API is slightly different. I tried (https://github.com/kylebarron/arrow-rs/pull/3/files#diff-73978efa44253b6c1cafc48e0fd042b761ebfff35cb32c9f53717d1641dab0fe) to update `parquet/src/compression.rs` to the `lz4-flex` API. It compiles fine but I get panics when testing the WASM with an LZ4 parquet file in the browser. I don't really know what I'm doing wrong πŸ˜… . Switching out to `lz4-flex` seems very achievable by someone who knows Rust better than I do πŸ˜„ .
   - [ ] LZO: I see references to LZO compression in `parquet/src/basic.rs` but it doesn't seem to be implemented in `parquet/src/compression.rs`? I hadn't heard of LZO before. According to Wes, [LZO isn't really used anymore](https://github.com/apache/arrow/issues/2209#issuecomment-402859258), so I don't see myself working on this.
   
   In terms of Arrow IPC files being malformatted, I switched from `arrow::ipc::writer::StreamWriter` to `arrow::ipc::writer::FileWriter`. Now all the Arrow files generated by `parquet-wasm` from my Parquet test files are readable in _Python_ using `pa.ipc.open_file`, so presumably the JS errors arising from `arrow.tableFromIPC(tableBytes)` are issues with the JS library and its IPC parser.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] kylebarron commented on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
kylebarron commented on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1053764129


   I made [another effort](https://github.com/kylebarron/parquet-wasm) on top of @andyredhead 's [helpful repo](https://github.com/my-liminal-space/read-parquet-browser) to create a minimal JS parser from Parquet to Arrow. So far it seems to work with Snappy and uncompressed Parquet files, though the generated Arrow IPC files seem to be occasionally malformatted (errors of `Expected to read 1264832 metadata bytes, but only read 700`). To support gzip it looks like we could try using `flate2` when building for wasm: https://github.com/rust-lang/flate2-rs/issues/161.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] kylebarron commented on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
kylebarron commented on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-990107948


   Just wondering if there's anything actionable here or if it's open ended without a clear solution. I'm just starting to learn rust but would love for this to work in wasm.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] kylebarron edited a comment on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
kylebarron edited a comment on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1058827130


   Another update on the compression codecs:
   
   - [x] Uncompressed
   - [x] Snappy: works out of the box with `snap` feature
   - [x] Gzip: works out of the box with the `flate2` feature
   - [x] Brotli: works out of the box with the `brotli` feature. (I thought this had failed for me before, so maybe it was [updating my llvm/clang](https://github.com/kylebarron/parquet-wasm/pull/2) while debugging ZSTD that caused this to work).
   - [x] ZSTD: works with [this unreleased commit](https://github.com/gyscos/zstd-rs/commit/d6bfa32d09b8e4ef747c9b57109974c270ffab72) on `zstd-rs`, merged in January 2022, a day after the `0.10.0` release was cut πŸ₯² . Tested working when pointing to the latest `zstd-rs` master and with `default-features = false`. Hopefully they make a new release soon. (Should work as of #1414)
   - [ ] LZ4: The currently used [`lz4-rs`](https://github.com/10XGenomics/lz4-rs) hasn't had a release since June 8, 2020. It accepted a PR from July 2020 that [purported to add support for `wasm32-unknown-unknown`](https://github.com/10XGenomics/lz4-rs/pull/11) but I pulled their repo and couldn't get it to build for that target.
   
   	[`lz4-flex`](https://github.com/PSeitz/lz4_flex) successfully compiles to WASM, but the API is slightly different. I tried (https://github.com/kylebarron/arrow-rs/pull/3/files#diff-73978efa44253b6c1cafc48e0fd042b761ebfff35cb32c9f53717d1641dab0fe) to update `parquet/src/compression.rs` to the `lz4-flex` API. It compiles fine but I get panics when testing the WASM with an LZ4 parquet file in the browser. I don't really know what I'm doing wrong πŸ˜… . Switching out to `lz4-flex` seems very achievable by someone who knows Rust better than I do πŸ˜„ .
   - [ ] LZO: I see references to LZO compression in `parquet/src/basic.rs` but it doesn't seem to be implemented in `parquet/src/compression.rs`? I hadn't heard of LZO before. According to Wes, [LZO isn't really used anymore](https://github.com/apache/arrow/issues/2209#issuecomment-402859258), so I don't see myself working on this.
   
   In terms of Arrow IPC files being malformatted, I switched from `arrow::ipc::writer::StreamWriter` to `arrow::ipc::writer::FileWriter`. Now all the Arrow files generated by `parquet-wasm` from my Parquet test files are readable in _Python_ using `pa.ipc.open_file`, so presumably the JS errors arising from `arrow.tableFromIPC(tableBytes)` are issues with the JS library and its IPC parser. (It looks like there are known issues with the IPC support in JS [ARROW-15642](https://issues.apache.org/jira/browse/ARROW-15642), [ARROW-13818](https://issues.apache.org/jira/browse/ARROW-13818), [ARROW-8674](https://issues.apache.org/jira/browse/ARROW-8674))


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] andyredhead commented on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
andyredhead commented on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1004108660


   I had a play with getting a minimalist apache (v1) arrow & parquet to compile to wasm32-unknown-unknown back in July/August (2021) when the released version of arrow was ~5.0. It worked ok, I vaguely remember having to do something around adding an annotation on the hashcode for one of the structs to point rustc at an implementation that worked in wasm (I'm very new to Rust and definitely still in the "muddling through" phase").
   
   My tinkering has been on the "back burner" since September (for a number of reasons, not least the hard disk on my personal laptop dying), I got chance over the Christmas break just gone to recover what I can from the dead disk and get started again :)
   
   The apache arrow-rs v6.5.0 crate builds without any modifications :)
   
   I've put the (very basic) results of my tinkering into a [git repo](https://github.com/my-liminal-space/read-parquet-browser). Its based on the "Rust and Webassembly" example project, uses the parquet crate to read a parquet file and the javascript arrow library to read values out of the result.
   
   I recently stumbled across a reference to the arrow2/parquet2 projects, the design goals seem sensible but I haven't had chance to look at them yet.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] alamb commented on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
alamb commented on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1005195856


   Yeah -- we now test to ensure that Arrow builds on wasm as part of all the CI runs:
   
   https://github.com/apache/arrow-rs/runs/4685124037?check_suite_focus=true


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] kylebarron commented on issue #180: Parquet does not support wasm32-unknown-unknown target

Posted by GitBox <gi...@apache.org>.
kylebarron commented on issue #180:
URL: https://github.com/apache/arrow-rs/issues/180#issuecomment-1058827130


   Another update on the compression codecs:
   
   - [x] Uncompressed
   - [x] Snappy: works out of the box with `snap` feature
   - [x] Gzip: works out of the box with the `flate2` feature
   - [x] Brotli: works out of the box with the `brotli` feature. (I thought this had failed for me before, so maybe it was [updating my llvm/clang](https://github.com/kylebarron/parquet-wasm/pull/2) while debugging ZSTD that caused this to work).
   - [x] ZSTD: works with [this unreleased commit](https://github.com/gyscos/zstd-rs/commit/d6bfa32d09b8e4ef747c9b57109974c270ffab72) on `zstd-rs`, merged in January 2022, a day after the `0.10.0` release was cut πŸ₯² . Tested working when pointing to the latest `zstd-rs` master and with `default-features = false`. Hopefully they make a new release soon.
   - [ ] LZ4: The currently used [`lz4-rs`](https://github.com/10XGenomics/lz4-rs) hasn't had a release since June 8, 2020. It accepted a PR from July 2020 that [purported to add support for `wasm32-unknown-unknown`](https://github.com/10XGenomics/lz4-rs/pull/11) but I pulled their repo and couldn't get it to build for that target.
   
   	[`lz4-flex`](https://github.com/PSeitz/lz4_flex) successfully compiles to WASM, but the API is slightly different. I tried (https://github.com/kylebarron/arrow-rs/pull/3/files#diff-73978efa44253b6c1cafc48e0fd042b761ebfff35cb32c9f53717d1641dab0fe) to update `parquet/src/compression.rs` to the `lz4-flex` API. It compiles fine but I get panics when testing the WASM with an LZ4 parquet file in the browser. I don't really know what I'm doing wrong πŸ˜… . Switching out to `lz4-flex` seems very achievable by someone who knows Rust better than I do πŸ˜„ .
   - [ ] LZO: I see references to LZO compression in `parquet/src/basic.rs` but it doesn't seem to be implemented in `parquet/src/compression.rs`? I hadn't heard of LZO before.
   
   In terms of Arrow IPC files being malformatted, I switched from `arrow::ipc::writer::StreamWriter` to `arrow::ipc::writer::FileWriter`. Now all the Arrow files generated by `parquet-wasm` from my Parquet test files are readable in _Python_ using `pa.ipc.open_file`, so presumably the JS errors arising from `arrow.tableFromIPC(tableBytes)` are issues with the JS library and its IPC parser.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org