You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "wjones127 (via GitHub)" <gi...@apache.org> on 2023/11/19 01:20:39 UTC
[I] Parquet: Bring ArrowWriter methods over to AsyncArrowWriter [arrow-rs]
wjones127 opened a new issue, #5099:
URL: https://github.com/apache/arrow-rs/issues/5099
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
I noticed that [AsyncArrowWriter](https://docs.rs/parquet/latest/parquet/arrow/async_writer/struct.AsyncArrowWriter.html) is missing a bunch of methods that [ArrowWriter](https://docs.rs/parquet/latest/parquet/arrow/arrow_writer/struct.ArrowWriter.html) has, such as `in_progress_size()`.
Also on either, it's not clear how to get the total size of data written + total size buffered, which I think most users want. IIUC that's a documentation issue, since I think folks have already enabled that information to be retrieved.
**Describe the solution you'd like**
Port methods and improve usage docs.
**Describe alternatives you've considered**
<!--
A clear and concise description of any alternative solutions or features you've considered.
-->
**Additional context**
<!--
Add any other context or screenshots about the feature request here.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Parquet: Bring ArrowWriter methods over to AsyncArrowWriter [arrow-rs]
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold closed issue #5099: Parquet: Bring ArrowWriter methods over to AsyncArrowWriter
URL: https://github.com/apache/arrow-rs/issues/5099
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Parquet: Bring ArrowWriter methods over to AsyncArrowWriter [arrow-rs]
Posted by "AdamGS (via GitHub)" <gi...@apache.org>.
AdamGS commented on issue #5099:
URL: https://github.com/apache/arrow-rs/issues/5099#issuecomment-1870666855
We use the async writer a lot, and I would be happy to try and take a stab at this issue, should have the time and bandwidth in the next couple of weeks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Parquet: Bring ArrowWriter methods over to AsyncArrowWriter [arrow-rs]
Posted by "AdamGS (via GitHub)" <gi...@apache.org>.
AdamGS commented on issue #5099:
URL: https://github.com/apache/arrow-rs/issues/5099#issuecomment-1870955481
Ok took a look and it was actually shorter than I expected from the description. Got a draft open but its still missing some things.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org