You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "westonpace (via GitHub)" <gi...@apache.org> on 2023/02/09 02:50:34 UTC

[GitHub] [arrow] westonpace commented on issue #34085: [Python][C++] pyarrow can I use write_dataset to write CSV as gzip compressed ?

westonpace commented on issue #34085:
URL: https://github.com/apache/arrow/issues/34085#issuecomment-1423542119

   No.  It is not possible to do today.  I agree it would be nice to support.  In the reader we have the concept of an "arbitrary input stream transform" (that transform can be decompression).  I think the writer could have a similar concept (with a compression transform).  It would only be useful for the text formats (csv, json).
   
   CC @benibus 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org