You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2022/09/22 16:50:00 UTC
[jira] [Comment Edited] (ARROW-17791) [Python][CI] Some nightly jobs are failing due to ACCESS_DENIED to S3 bucket
[ https://issues.apache.org/jira/browse/ARROW-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17608346#comment-17608346 ]
Joris Van den Bossche edited comment on ARROW-17791 at 9/22/22 4:49 PM:
------------------------------------------------------------------------
I was checking further differences between both runs based on the logs, and the failing build has those additional env variables set:
{code}
env:
...
AWS_SECRET_ACCESS_KEY: ***
AWS_ACCESS_KEY_ID: ***
SCCACHE_BUCKET: ***
SCCACHE_S3_KEY_PREFIX: sccache
{code}
and those are not present in the working build. So probably something to do with the sccache change? (https://github.com/apache/arrow/pull/13556, cc [~assignUser])
was (Author: jorisvandenbossche):
I was checking further differences between both runs based on the logs, and the failing build has those additional env variables set:
{code}
env:
...
AWS_SECRET_ACCESS_KEY: ***
AWS_ACCESS_KEY_ID: ***
SCCACHE_BUCKET: ***
SCCACHE_S3_KEY_PREFIX: sccache
{code}
and those are not present in the working build. So probably something to do with the sccache change? (cc [~assignUser])
> [Python][CI] Some nightly jobs are failing due to ACCESS_DENIED to S3 bucket
> ----------------------------------------------------------------------------
>
> Key: ARROW-17791
> URL: https://issues.apache.org/jira/browse/ARROW-17791
> Project: Apache Arrow
> Issue Type: Bug
> Components: Continuous Integration, Python
> Reporter: Raúl Cumplido
> Priority: Critical
> Labels: Nightly
>
> The following nitghly failures:
> * [test-conda-python-3.10|https://github.com/ursacomputing/crossbow/actions/runs/3094438413/jobs/5007812721]
> * [test-conda-python-3.7|https://github.com/ursacomputing/crossbow/actions/runs/3094412849/jobs/5007760110]
> * [test-conda-python-3.7-pandas-0.24|https://github.com/ursacomputing/crossbow/actions/runs/3094422644/jobs/5007779545]
> * [test-conda-python-3.7-pandas-latest|https://github.com/ursacomputing/crossbow/actions/runs/3094419759/jobs/5007773935]
> * [test-conda-python-3.8|https://github.com/ursacomputing/crossbow/actions/runs/3094444904/jobs/5007827002]
> * [test-conda-python-3.8-pandas-latest|https://github.com/ursacomputing/crossbow/actions/runs/3094405494/jobs/5007746062]
> * [test-conda-python-3.8-pandas-nightly|https://github.com/ursacomputing/crossbow/actions/runs/3094407475/jobs/5007750212]
> * [test-conda-python-3.9|https://github.com/ursacomputing/crossbow/actions/runs/3094450745/jobs/5007839959]
> * [test-conda-python-3.9-pandas-master|https://github.com/ursacomputing/crossbow/actions/runs/3094401032/jobs/5007736715]
> * [test-debian-11-python-3|https://github.com/ursacomputing/crossbow/runs/8465194776]
> Failed Python test_s3_real_aws_region_selection with ACCESS_DENIED:
> {code:java}
> =================================== FAILURES ===================================
> ______________________ test_s3_real_aws_region_selection _______________________ @pytest.mark.s3
> def test_s3_real_aws_region_selection():
> # Taken from a registry of open S3-hosted datasets
> # at https://github.com/awslabs/open-data-registry
> fs, path = FileSystem.from_uri('s3://mf-nwp-models/README.txt')
> assert fs.region == 'eu-west-1'
> > with fs.open_input_stream(path) as f:opt/conda/envs/arrow/lib/python3.10/site-packages/pyarrow/tests/test_fs.py:1660:
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> pyarrow/_fs.pyx:805: in pyarrow._fs.FileSystem.open_input_stream
> ???
> pyarrow/error.pxi:144: in pyarrow.lib.pyarrow_internal_check_status
> ???
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > ???
> E OSError: When reading information for key 'README.txt' in bucket 'mf-nwp-models': AWS Error ACCESS_DENIED during HeadObject operation: No response body.pyarrow/error.pxi:115: OSError {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)