You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "John (Jira)" <ji...@apache.org> on 2022/10/14 13:03:00 UTC

[jira] [Created] (ARROW-18052) pyarrow.parquet.write_to_dataset permssion denied when write to s3 bucket in another account

John created ARROW-18052:
----------------------------

             Summary: pyarrow.parquet.write_to_dataset permssion denied when write to s3 bucket in another account
                 Key: ARROW-18052
                 URL: https://issues.apache.org/jira/browse/ARROW-18052
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 9.0.0
            Reporter: John


We are using pyarrow.parquet.write_to_dataset to write to an s3 file system in another account.  This fails because write_to_dataset calls pyarrow.dataset.write_dataset with create_dir=True.  There is not a parameter in the call to write_to_dataset that allows you to set create_dir to False.  When setting it to False, this works correctly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)