You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@paimon.apache.org by lz...@apache.org on 2023/04/25 02:26:10 UTC
[incubator-paimon] 03/17: [doc] Add S3A performance for S3
This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a commit to branch release-0.4
in repository https://gitbox.apache.org/repos/asf/incubator-paimon.git
commit d636f2709611b1b2b31e506fa23ab687f63615a7
Author: JingsongLi <lz...@aliyun.com>
AuthorDate: Sun Apr 23 09:15:13 2023 +0800
[doc] Add S3A performance for S3
---
docs/content/filesystems/s3.md | 9 +++++++++
1 file changed, 9 insertions(+)
diff --git a/docs/content/filesystems/s3.md b/docs/content/filesystems/s3.md
index c3505d26f..3390451c4 100644
--- a/docs/content/filesystems/s3.md
+++ b/docs/content/filesystems/s3.md
@@ -135,3 +135,12 @@ In such cases, you will have to provide the property to enable path style access
s3.path.style.access: true
```
+## S3A Performance
+
+[Tune Performance](https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/performance.html) for `S3AFileSystem`.
+
+If you encounter the following exception:
+```shell
+Caused by: org.apache.http.conn.ConnectionPoolTimeoutException: Timeout waiting for connection from pool.
+```
+Try to configure this in catalog options: `fs.s3a.connection.maximum=1000`.