You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@texera.apache.org by "xuang7 (via GitHub)" <gi...@apache.org> on 2025/10/08 00:41:10 UTC

[I] Presigned URL expiration causes upload failure after 30 minutes [texera]

xuang7 opened a new issue, #3837:
URL: https://github.com/apache/texera/issues/3837

   ### What happened?
   
   Large uploads fail mid-transfer because presigned URLs expire at ~30 minutes (X-Amz-Expires=1800). If the transfer hasn’t finished before expiry, the request returns 403 Forbidden and the upload fails.
   
   Screenshot of the request:
   <img width="1254" height="998" alt="Image" src="https://github.com/user-attachments/assets/ad57a194-02a1-4ffc-bccb-dcf1f0bb048d" />
   
   ### How to reproduce?
   
   1. Start a large upload (e.g., ≥ 50–200 GB).
   2. Ensure the transfer time exceeds 30 minutes
   3. After ~30 min, requests using the original presigned URL begin failing with 403 Forbidden.
   
   ### Version
   
   1.1.0-incubating (Pre-release/Master)
   
   ### Commit Hash (Optional)
   
   _No response_
   
   ### What browsers are you seeing the problem on?
   
   _No response_
   
   ### Relevant log output
   
   ```shell
   
   ```
   
   ### Code of Conduct
   
   - [x] I agree to follow Apache Code of Conduct


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@texera.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Presigned URL expiration causes upload failure after 30 minutes [texera]

Posted by "xuang7 (via GitHub)" <gi...@apache.org>.
xuang7 commented on issue #3837:
URL: https://github.com/apache/texera/issues/3837#issuecomment-3383056269

   > For option 1, if we can make the expiration time very long (e.g., 100 years), is it a good solution?
   
   It’s risky to rely on simply extending presigned URL expirations due to security and leak concerns, so I’ll try the alternative approach of re-presigning expired parts and fetching presigned URLs on demand.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Presigned URL expiration causes upload failure after 30 minutes [texera]

Posted by "chenlica (via GitHub)" <gi...@apache.org>.
chenlica commented on issue #3837:
URL: https://github.com/apache/texera/issues/3837#issuecomment-3382254961

   For option 1, if we can make the expiration time very long (e.g., 100 years), is it a good solution?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Presigned URL expiration causes upload failure after 30 minutes [texera]

Posted by "xuang7 (via GitHub)" <gi...@apache.org>.
xuang7 closed issue #3837: Presigned URL expiration causes upload failure after 30 minutes
URL: https://github.com/apache/texera/issues/3837


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Presigned URL expiration causes upload failure after 30 minutes [texera]

Posted by "xuang7 (via GitHub)" <gi...@apache.org>.
xuang7 commented on issue #3837:
URL: https://github.com/apache/texera/issues/3837#issuecomment-3379183769

   Possible Solutions:
   1. Increase/configure the expiration time of presigned URLs.
   2. Retrieve presigned URLs on demand rather than all at once.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org