You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "shanyu zhao (JIRA)" <ji...@apache.org> on 2015/02/24 20:47:05 UTC
[jira] [Created] (HADOOP-11629) WASB filesystem should not start
BandwidthGaugeUpdater if fs.azure.skip.metrics set to true
shanyu zhao created HADOOP-11629:
------------------------------------
Summary: WASB filesystem should not start BandwidthGaugeUpdater if fs.azure.skip.metrics set to true
Key: HADOOP-11629
URL: https://issues.apache.org/jira/browse/HADOOP-11629
Project: Hadoop Common
Issue Type: Bug
Components: tools
Affects Versions: 2.6.1
Reporter: shanyu zhao
Assignee: shanyu zhao
In Hadoop-11248 we added configuration "fs.azure.skip.metrics". If set to true, we do not register Azure FileSystem metrics with the metrics system. However, BandwidthGaugeUpdater object is still created in AzureNativeFileSystemStore, resulting in unnecessary threads being spawned.
Under heavy load the system could be busy dealing with these threads and GC has to work on removing the thread objects. E.g. When multiple WebHCat clients submitting jobs to WebHCat server, we observed that the WebHCat server spawns ~400 daemon threads, which slows down the server and sometimes cause timeout.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)