You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2022/10/21 15:07:00 UTC
[jira] [Updated] (ARROW-18052) [Python] pyarrow.parquet.write_to_dataset permssion denied when write to s3 bucket in another account
[ https://issues.apache.org/jira/browse/ARROW-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joris Van den Bossche updated ARROW-18052:
------------------------------------------
Summary: [Python] pyarrow.parquet.write_to_dataset permssion denied when write to s3 bucket in another account (was: pyarrow.parquet.write_to_dataset permssion denied when write to s3 bucket in another account)
> [Python] pyarrow.parquet.write_to_dataset permssion denied when write to s3 bucket in another account
> -----------------------------------------------------------------------------------------------------
>
> Key: ARROW-18052
> URL: https://issues.apache.org/jira/browse/ARROW-18052
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 9.0.0
> Reporter: John
> Assignee: Miles Granger
> Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> We are using pyarrow.parquet.write_to_dataset to write to an s3 file system in another account. This fails because write_to_dataset calls pyarrow.dataset.write_dataset with create_dir=True. There is not a parameter in the call to write_to_dataset that allows you to set create_dir to False. When setting it to False, this works correctly.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)