You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/05/21 15:56:00 UTC

[jira] [Created] (HADOOP-15485) reduce/tune read failure fault injection on inconsistent client

Steve Loughran created HADOOP-15485:
---------------------------------------

             Summary: reduce/tune read failure fault injection on inconsistent client
                 Key: HADOOP-15485
                 URL: https://issues.apache.org/jira/browse/HADOOP-15485
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3, test
    Affects Versions: 3.1.0
            Reporter: Steve Loughran


If you crank up the s3guard directory inconsistency rate to stress test the directory listings, then the read failure rate can go up high enough that things read IO fails,.

Maybe  that read injection should only happen for the first few seconds of a stream being created, to better model delayed consistency, or least limit the #of times it can surface in a stream. (This woluld imply some kind of stream-specific binding....)

Otherwise: provide a way to explicitly set it, including disable



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org