You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "loneylee (via GitHub)" <gi...@apache.org> on 2024/10/11 09:25:16 UTC
[I] [CH]Remove redundant head object operation of s3 [incubator-gluten]
loneylee opened a new issue, #7482:
URL: https://github.com/apache/incubator-gluten/issues/7482
### Description
From spark 3.3+, driver will get file size and modify time. It can be send to backend by substrait.
The backend code will not need:
```
DB::S3::ObjectInfo object_info = DB::S3::getObjectInfo(*client, bucket, key, "");
size_t object_size = object_info.size;
nt64 object_modified_time = object_info.last_modification_time;
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CH]Remove redundant head object operation of s3 [incubator-gluten]
Posted by "baibaichen (via GitHub)" <gi...@apache.org>.
baibaichen closed issue #7482: [CH]Remove redundant head object operation of s3
URL: https://github.com/apache/incubator-gluten/issues/7482
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org