[GitHub] [airflow] spelufo commented on issue #23965: S3 keys provided by aws/log/s3_task_handler.py to s3 hook contain the prefix `s3://`, causing minio bad request.

[GitBox <gi...@apache.org>]

spelufo commented on issue #23965:
URL: https://github.com/apache/airflow/issues/23965#issuecomment-1142062640

   I tested it against S3, and what happens is that it does work, but it interprets the key as a path, creating folders called `s3:/`, `/`, ..., not what should be expected to happen. Unless I'm configuring airflow wrong somehow I think this behavior is a bug in airflow. I think I configured everything in accordance with the docs, but let me know how I can help or if you can't reproduce the issue
   <img width="1137" alt="Screen Shot 2022-05-31 at 14 11 23" src="https://user-images.githubusercontent.com/1312203/171170248-f729490c-e4e2-4218-b824-fa161fd7f8c9.png">
   
   I don't think it's necessary to contact minio about the airflow issue. They might want to do the same that S3 does with this kind of key instead of responding with bad request, but after testing against S3 I think that's a separate issue from airflow sending keys with the `s3://{bucket_name}` prefix. I'll open a minio issue linking here to let them know this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org