[GitHub] [arrow-rs] alamb commented on issue #3740: Support for Async CSV Writer

["alamb (via GitHub)" <gi...@apache.org>]

alamb commented on issue #3740:
URL: https://github.com/apache/arrow-rs/issues/3740#issuecomment-1445122685

   For more context, I believe the use case for this feature may be related to https://github.com/apache/arrow-datafusion/issues/5130
   
   Having a "native" async csv writer in arrow-rs I can see being a compelling UX feature (aka it would make it easier to use and integrate). However, I don't know how much easier it would be and how much maintenance it would require. 
   
   I really like the idea, mentioned in a few places on this thread, of creating an async CSV writer by wrapping the existing blocking / batching one outside of arrow-rs initially (I don't think there is any reason this can not be done). 
   
   Once we have the actual code and an an example use of it it, then we will be in a much better position to evaluate how it performs compared to a "native" async writer, how it is actually used, and if we should reconsider incorporating it into arrow-rs 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org