[GitHub] [iceberg] singhpk234 commented on a diff in pull request #8037: Docs: Add warning in tiered storage

["singhpk234 (via GitHub)" <gi...@apache.org>]

singhpk234 commented on code in PR #8037:
URL: https://github.com/apache/iceberg/pull/8037#discussion_r1259990625


##########
docs/spark-procedures.md:
##########
@@ -514,6 +514,10 @@ will then treat these files as if they are part of the set of files  owned by Ic
 `expire_snapshot` calls will be able to physically delete the added files. This method should not be used if 
 `migrate` or `snapshot` are possible.
 
+{{< hint warning >}}
+Keep in mind the `add_files` procedure will fetch the Parquet metadat from each file being added just once. If you're using tiered storage, (such as [Amazon S3 Intelligent-Tiering storage class](https://aws.amazon.com/s3/storage-classes/intelligent-tiering/)), the file will be retrieved from the archive, and will be on a higher tier for a set period of time.

Review Comment:
   ```suggestion
   Keep in mind the `add_files` procedure will fetch the Parquet metadata from each file being added just once. If you're using tiered storage, (such as [Amazon S3 Intelligent-Tiering storage class](https://aws.amazon.com/s3/storage-classes/intelligent-tiering/)), the underlying, file will be retrieved from the archive, and will remain on a higher tier for a set period of time.
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org