[GitHub] [arrow-datafusion] alamb commented on issue #5130: Using INSERT INTO query to write a file

["alamb (via GitHub)" <gi...@apache.org>]

alamb commented on issue #5130:
URL: https://github.com/apache/arrow-datafusion/issues/5130#issuecomment-1411978522

   👍  I would very much like a feature like this too.
   
   The use of `SELECT` is also compelling to me because you can then filter and order, for example. 
   
   Some ideal features (doesn't have to be in the first implementation, but it would be nice if the API supported this):
   1. Support multiple different types of format (CSV as well as parquet, for example)
   2. support potenteially writing to a directory (and writing out multiple smaller files)
   3. Have some way to control the options for the output writer (e.g. for CSV the format of timestamps, for parquet row group size, etc)
   
   
   @andygrove  and @Dandandan  do you have thoughts on what this feature might look like?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org