Re: TcpDiscoveryS3IpFinder AmazonS3Exception: Slow Down

[afedotov <al...@gmail.com>]

Hi Dave,

Probably switching to VPC increased the request rate what caused the
mentioned exception.

Please share the corresponding Ignite logs.

Kind regards,
Alex



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: TcpDiscoveryS3IpFinder AmazonS3Exception: Slow Down

[Dave Harvey <dh...@jobcase.com>]

Opened a support tickets with GridGain and AWS.  The former suggested this,
which helped:

 20                         <property name="awsCredentials"
ref="aws.creds"/>
 21                         <property name="clientConfiguration">
 22                             <bean
class="com.amazonaws.ClientConfiguration">
 23                                 <property name="maxErrorRetry"
value="20"/>
 24                             </bean>
 25                         </property>

The throttling is per S3 bucket, and S3 discovery requires a private bucket
(or you get lots of errors), and AWS confirmed that the load was light, and
the errors were always on the first bucket enum.   They did suggest moving
from version 1.11.75 of the aws libs to 1.11.219, but fundamentally, they
delayed responding for long enough for the symptoms to go away on their own,
without explanation.   I can no longer reproduce, without any changes.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/