You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/05/21 15:56:00 UTC
[jira] [Created] (HADOOP-15485) reduce/tune read failure fault
injection on inconsistent client
Steve Loughran created HADOOP-15485:
---------------------------------------
Summary: reduce/tune read failure fault injection on inconsistent client
Key: HADOOP-15485
URL: https://issues.apache.org/jira/browse/HADOOP-15485
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3, test
Affects Versions: 3.1.0
Reporter: Steve Loughran
If you crank up the s3guard directory inconsistency rate to stress test the directory listings, then the read failure rate can go up high enough that things read IO fails,.
Maybe that read injection should only happen for the first few seconds of a stream being created, to better model delayed consistency, or least limit the #of times it can surface in a stream. (This woluld imply some kind of stream-specific binding....)
Otherwise: provide a way to explicitly set it, including disable
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org