You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@accumulo.apache.org by Jim Hughes <jh...@ccri.com> on 2021/06/09 21:05:18 UTC

Accumulo on S3 tuning for write performance

Hi all,

We are trying a large ingest using Accumulo on S3 and we are seeing some 
exceptions around writes to S3.  The blog post about Accumulo on S3[1] 
suggests setting "fs.s3a.connection.maximum" to 128.  Similar advice for 
HBase seems to suggest bumping that value even higher.

Does anyone have any experience tuning that parameter or others to speed 
up writes to S3?

Cheers,

Jim

1. https://accumulo.apache.org/blog/2019/09/10/accumulo-S3-notes.html