RE: DFSClient/DistriburedFileSystem fault injection?

[Sergey Shelukhin <Se...@microsoft.com.INVALID>]

Adding the user list :)

-----Original Message-----
From: Sergey Shelukhin 
Sent: Monday, February 11, 2019 3:42 PM
To: hdfs-dev@hadoop.apache.org
Subject: DFSClient/DistriburedFileSystem fault injection?

Hi.
I've been looking for a client-side solution for fault injection in HDFS.
We had a naturally unstable HDFS cluster that helped uncover a lot of issues in HBase; now that it has been stabilized, we miss it already :)

To keep testing without actually disrupting others' use of HDFS or having to deploy a new version, I was thinking about having a client-side schema (e.g. fhdfs) map to a wrapper over the standard DFS that would inject failures and delays according to some configs, similar to https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/FaultInjectFramework.html 

However I wonder if something like this exists already?

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org