You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "daimin (Jira)" <ji...@apache.org> on 2021/12/30 08:16:00 UTC
[jira] [Created] (HDFS-16403) Improve FUSE IO performance by supporting FUSE parameter max_background
daimin created HDFS-16403:
-----------------------------
Summary: Improve FUSE IO performance by supporting FUSE parameter max_background
Key: HDFS-16403
URL: https://issues.apache.org/jira/browse/HDFS-16403
Project: Hadoop HDFS
Issue Type: Improvement
Components: fuse-dfs
Affects Versions: 3.3.1, 3.3.0
Reporter: daimin
Assignee: daimin
When we examining the FUSE IO performance on HDFS, we found that the simultaneous IO requests number are limited to a fixed number, like 12. This limitation makes the IO performance on FUSE client quite unacceptable. We did some research on this and inspired by the article [Performance and Resource Utilization of FUSE User-Space File Systems|https://dl.acm.org/doi/fullHtml/10.1145/3310148], clearly the FUSE parameter '{{{}max_background{}}}' decides the simultaneous IO requests number, which is 12 by default.
We add 'max_background' to fuse_dfs mount options, the FUSE kernel will take effect when an option value is given.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org