You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2022/10/27 15:50:00 UTC

[jira] [Resolved] (ARROW-18052) [Python] pyarrow.parquet.write_to_dataset permssion denied when write to s3 bucket in another account

     [ https://issues.apache.org/jira/browse/ARROW-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joris Van den Bossche resolved ARROW-18052.
-------------------------------------------
    Fix Version/s: 11.0.0
       Resolution: Fixed

Issue resolved by pull request 14459
[https://github.com/apache/arrow/pull/14459]

> [Python] pyarrow.parquet.write_to_dataset permssion denied when write to s3 bucket in another account
> -----------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-18052
>                 URL: https://issues.apache.org/jira/browse/ARROW-18052
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python
>    Affects Versions: 9.0.0
>            Reporter: John
>            Assignee: Miles Granger
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 11.0.0
>
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> We are using pyarrow.parquet.write_to_dataset to write to an s3 file system in another account.  This fails because write_to_dataset calls pyarrow.dataset.write_dataset with create_dir=True.  There is not a parameter in the call to write_to_dataset that allows you to set create_dir to False.  When setting it to False, this works correctly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)