You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "westonpace (via GitHub)" <gi...@apache.org> on 2023/06/29 13:41:51 UTC

[GitHub] [arrow] westonpace commented on issue #36280: [Python][Parquet] Allow `write_batch` to directly write batch

westonpace commented on issue #36280:
URL: https://github.com/apache/arrow/issues/36280#issuecomment-1613206010

   > Nowadays, WriteRecordBatch is supported in C++ ParquetWriter, so, it's possible that Python use WriteRecordBatch rather than WriteTable.
   
   How does `WriteRecordBatch` work?  Does it write the data to disk without closing the row group?  Wouldn't you get incomplete pages?  What if the batch only has 1 row?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org