You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "ryanhaarmann (via GitHub)" <gi...@apache.org> on 2025/08/18 22:26:02 UTC

[I] write_to_dataset(max_row_group_size) [arrow]

ryanhaarmann opened a new issue, #47361:
URL: https://github.com/apache/arrow/issues/47361

   I converted from using `pyarrow.dataset.write_dataset` to `pyarrow.parquet.write_to_dataset` and noticed that this section of code is overwriting my max_row_group_size param to None. It seems it forces the user to pass in chunksize or row_group_size. I think an additional kwargs.pop would be necessary here. 
   
   https://github.com/apache/arrow/blob/71a7b5531fd6ef96ce52d04491656031eb023c09/python/pyarrow/parquet/core.py#L2194-L2196


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org