You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "farmmamba (Jira)" <ji...@apache.org> on 2024/11/29 08:38:00 UTC
[jira] [Commented] (HDFS-17677) Too many DataStreamer and ResponseProcessor threads on client
[ https://issues.apache.org/jira/browse/HDFS-17677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17901873#comment-17901873 ]
farmmamba commented on HDFS-17677:
----------------------------------
[~shuaiqi.guo] Hi, shuaiqi. Can you paste more detailed information about the problems you met?
For examples, How many threads write files at the same time? What happened when too many threads created on client?
Thanks.
> Too many DataStreamer and ResponseProcessor threads on client
> -------------------------------------------------------------
>
> Key: HDFS-17677
> URL: https://issues.apache.org/jira/browse/HDFS-17677
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs-client
> Reporter: shuaiqi.guo
> Priority: Major
>
> hdfs client writes a large number of files at the same tine, then there are too many DataStreamer and ResponseProcessor threads on the client.
> Is there any way to improve this situation? For example, using NIO based on epoll.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org