You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "smengcl (via GitHub)" <gi...@apache.org> on 2023/03/31 18:14:20 UTC
[GitHub] [ozone] smengcl commented on pull request #4473: HDDS-8058. Gracefully handle invalid S3 request and authorization headers
smengcl commented on PR #4473:
URL: https://github.com/apache/ozone/pull/4473#issuecomment-1492403509
> Thanks @SaketaChalamchala for the patch. Please check S3 acceptance test failures, e.g.:
>
> [SaketaChalamchala/ozone/actions/runs/4516937717/jobs/7956106418#step:5:444](https://github.com/SaketaChalamchala/ozone/actions/runs/4516937717/jobs/7956106418#step:5:444)
I concur. The test failure in your fork's dev branch CI looks relevant:
```
test_create_bucket (__main__.TestBotoClient) ... ERROR
test_list_bucket (__main__.TestBotoClient) ... ok
test_head_bucket (__main__.TestBotoClient) ... ok
test_bucket_delete (__main__.TestBotoClient) ... ok
test_upload_file (__main__.TestBotoClient) ... ok
test_download_file (__main__.TestBotoClient) ... ok
test_delete_objects (__main__.TestBotoClient) ... ERROR:root:An error occurred (InvalidRequest) when calling the DeleteObjects operation: Error creating s3 auth info. The request may not be signed using AWS V4 signing algorithm, or might be invalid
ok
test_head_object (__main__.TestBotoClient) ... ok
test_multi_uploads (__main__.TestBotoClient) ... ERROR:root:An error occurred (InvalidRequest) when calling the CreateMultipartUpload operation: Error creating s3 auth info. The request may not be signed using AWS V4 signing algorithm, or might be invalid
ok
======================================================================
ERROR: test_create_bucket (__main__.TestBotoClient)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/boto3/s3/transfer.py", line 288, in upload_file
future.result()
File "/usr/local/lib/python3.6/site-packages/s3transfer/futures.py", line 103, in result
return self._coordinator.result()
File "/usr/local/lib/python3.6/site-packages/s3transfer/futures.py", line 266, in result
raise self._exception
File "/usr/local/lib/python3.6/site-packages/s3transfer/tasks.py", line 139, in __call__
return self._execute_main(kwargs)
File "/usr/local/lib/python3.6/site-packages/s3transfer/tasks.py", line 162, in _execute_main
return_value = self._main(**kwargs)
File "/usr/local/lib/python3.6/site-packages/s3transfer/tasks.py", line 349, in _main
Bucket=bucket, Key=key, **extra_args
File "/usr/local/lib/python3.6/site-packages/botocore/client.py", line 401, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/local/lib/python3.6/site-packages/botocore/client.py", line 731, in _make_api_call
raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (InvalidRequest) when calling the CreateMultipartUpload operation: Error creating s3 auth info. The request may not be signed using AWS V4 signing algorithm, or might be invalid
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/hadoop/smoketest/s3/boto_client.py", line 78, in setUp
self.s3.Bucket(str(self.target_bucket)).upload_file('./multiUpload.gz','multiUpload.1.gz')
File "/usr/local/lib/python3.6/site-packages/boto3/s3/inject.py", line 239, in bucket_upload_file
Config=Config,
File "/usr/local/lib/python3.6/site-packages/boto3/s3/inject.py", line 148, in upload_file
callback=Callback,
File "/usr/local/lib/python3.6/site-packages/boto3/s3/transfer.py", line 296, in upload_file
filename, '/'.join([bucket, key]), e
boto3.exceptions.S3UploadFailedError: Failed to upload ./multiUpload.gz to erasure/multiUpload.1.gz: An error occurred (InvalidRequest) when calling the CreateMultipartUpload operation: Error creating s3 auth info. The request may not be signed using AWS V4 signing algorithm, or might be invalid
----------------------------------------------------------------------
Ran 9 tests in 2.098s
FAILED (errors=1)
{'ResponseMetadata': {'RequestId': 'f4f5561b-7ea5-4685-b685-bfd3aeb3ff73', 'HostId': '8Dv1t0Cb0cJe', 'HTTPStatusCode': 200, 'HTTPHeaders': {'date': 'Sat, 25 Mar 2023 04:08:28 GMT', 'cache-control': 'no-cache', 'expires': 'Sat, 25 Mar 2023 04:08:28 GMT', 'pragma': 'no-cache', 'content-type': 'text/plain;charset=utf-8', 'x-content-type-options': 'nosniff', 'x-xss-protection': '1; mode=block', 'x-frame-options': 'SAMEORIGIN', 'location': 'http://s3g:9878/ozone-test-xehtenwgjo', 'server': 'Ozone', 'x-amz-id-2': '8Dv1t0Cb0cJe', 'x-amz-request-id': 'f4f5561b-7ea5-4685-b685-bfd3aeb3ff73', 'content-length': '0'}, 'RetryAttempts': 0}, 'Location': 'http://s3g:9878/ozone-test-xehtenwgjo'}
None
None
None
{'ResponseMetadata': {'RequestId': '50c351a9-383c-4b05-8db0-56a4da87a5c4', 'HostId': '0XOKGRqMQSFv', 'HTTPStatusCode': 200, 'HTTPHeaders': {'date': 'Sat, 25 Mar 2023 04:08:29 GMT', 'cache-control': 'no-cache', 'expires': 'Sat, 25 Mar 2023 04:08:29 GMT', 'pragma': 'no-cache', 'content-type': 'application/xml', 'x-content-type-options': 'nosniff', 'x-xss-protection': '1; mode=block', 'x-frame-options': 'SAMEORIGIN', 'server': 'Ozone', 'x-amz-id-2': '0XOKGRqMQSFv', 'x-amz-request-id': '50c351a9-383c-4b05-8db0-56a4da87a5c4', 'content-length': '365'}, 'RetryAttempts': 0}, 'Buckets': [{'Name': 'erasure', 'CreationDate': datetime.datetime(2023, 3, 25, 4, 8, 15, 523000, tzinfo=tzlocal())}, {'Name': 'ozone-test-xehtenwgjo', 'CreationDate': datetime.datetime(2023, 3, 25, 4, 8, 28, 180000, tzinfo=tzlocal())}]}
{'ResponseMetadata': {'RequestId': 'a4761e99-9584-469d-bf37-eaeb7107101a', 'HostId': 'AWnIZl14x', 'HTTPStatusCode': 200, 'HTTPHeaders': {'date': 'Sat, 25 Mar 2023 04:08:29 GMT', 'cache-control': 'no-cache', 'expires': 'Sat, 25 Mar 2023 04:08:29 GMT', 'pragma': 'no-cache', 'content-type': 'application/x-www-form-urlencoded', 'x-content-type-options': 'nosniff', 'x-xss-protection': '1; mode=block', 'x-frame-options': 'SAMEORIGIN', 'server': 'Ozone', 'x-amz-id-2': 'AWnIZl14x', 'x-amz-request-id': 'a4761e99-9584-469d-bf37-eaeb7107101a', 'content-length': '0'}, 'RetryAttempts': 0}}
{'ResponseMetadata': {'RequestId': '37f53a12-86d8-48a2-864c-558d76700e97', 'HostId': '3O6rrx15oiMEgyI', 'HTTPStatusCode': 204, 'HTTPHeaders': {'date': 'Sat, 25 Mar 2023 04:08:29 GMT', 'cache-control': 'no-cache', 'expires': 'Sat, 25 Mar 2023 04:08:29 GMT', 'pragma': 'no-cache', 'content-type': 'text/plain;charset=utf-8', 'x-content-type-options': 'nosniff', 'x-xss-protection': '1; mode=block', 'x-frame-options': 'SAMEORIGIN', 'server': 'Ozone', 'x-amz-id-2': '3O6rrx15oiMEgyI', 'x-amz-request-id': '37f53a12-86d8-48a2-864c-558d76700e97'}, 'RetryAttempts': 0}}
{'ResponseMetadata': {'RequestId': 'ab097016-ba8f-43ed-8d7c-fef650ab3f0f', 'HostId': 'mZjfEMlr', 'HTTPStatusCode': 200, 'HTTPHeaders': {'date': 'Sat, 25 Mar 2023 04:08:29 GMT', 'cache-control': 'no-cache', 'expires': 'Sat, 25 Mar 2023 04:08:29 GMT', 'pragma': 'no-cache', 'content-type': 'binary/octet-stream', 'x-content-type-options': 'nosniff', 'x-xss-protection': '1; mode=block', 'x-frame-options': 'SAMEORIGIN', 'etag': '2023-03-25T04:08:29.601Z', 'last-modified': 'Sat, 25 Mar 2023 04:08:29 GMT', 'server': 'Ozone', 'x-amz-id-2': 'mZjfEMlr', 'x-amz-request-id': 'ab097016-ba8f-43ed-8d7c-fef650ab3f0f', 'content-length': '3879'}, 'RetryAttempts': 0}, 'LastModified': datetime.datetime(2023, 3, 25, 4, 8, 29, tzinfo=tzutc()), 'ContentLength': 3879, 'ETag': '2023-03-25T04:08:29.601Z', 'CacheControl': 'no-cache', 'ContentType': 'binary/octet-stream', 'Expires': datetime.datetime(2023, 3, 25, 4, 8, 29, tzinfo=tzutc()), 'Metadata': {}}
An error occurred (InvalidRequest) when calling the DeleteObjects operation: Error creating s3 auth info. The request may not be signed using AWS V4 signing algorithm, or might be invalid
{'ResponseMetadata': {'RequestId': 'd5b90ab8-62a9-44b0-9645-1c30718e826f', 'HostId': 'Vdm5bMZEt6h', 'HTTPStatusCode': 200, 'HTTPHeaders': {'date': 'Sat, 25 Mar 2023 04:08:29 GMT', 'cache-control': 'no-cache', 'expires': 'Sat, 25 Mar 2023 04:08:29 GMT', 'pragma': 'no-cache', 'content-type': 'binary/octet-stream', 'x-content-type-options': 'nosniff', 'x-xss-protection': '1; mode=block', 'x-frame-options': 'SAMEORIGIN', 'etag': '2023-03-25T04:08:28.956Z', 'last-modified': 'Sat, 25 Mar 2023 04:08:28 GMT', 'server': 'Ozone', 'x-amz-id-2': 'Vdm5bMZEt6h', 'x-amz-request-id': 'd5b90ab8-62a9-44b0-9645-1c30718e826f', 'content-length': '3879'}, 'RetryAttempts': 0}, 'LastModified': datetime.datetime(2023, 3, 25, 4, 8, 28, tzinfo=tzutc()), 'ContentLength': 3879, 'ETag': '2023-03-25T04:08:28.956Z', 'CacheControl': 'no-cache', 'ContentType': 'binary/octet-stream', 'Expires': datetime.datetime(2023, 3, 25, 4, 8, 29, tzinfo=tzutc()), 'Metadata': {}}
An error occurred (InvalidRequest) when calling the CreateMultipartUpload operation: Error creating s3 auth info. The request may not be signed using AWS V4 signing algorithm, or might be invalid
Boto3 Client Test FAILED!
```
@SaketaChalamchala Would you take a look?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org