You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Jose Miguel Arreola (JIRA)" <ji...@apache.org> on 2017/03/16 22:45:41 UTC
[jira] [Updated] (HADOOP-14193) Cache the resolved hosts to prevent
calls to InetAddress.getByName and normalizeHost
[ https://issues.apache.org/jira/browse/HADOOP-14193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jose Miguel Arreola updated HADOOP-14193:
-----------------------------------------
Summary: Cache the resolved hosts to prevent calls to InetAddress.getByName and normalizeHost (was: Cache the resolved hosts prevent calls to InetAddress.getByName and normalizeHost)
> Cache the resolved hosts to prevent calls to InetAddress.getByName and normalizeHost
> ------------------------------------------------------------------------------------
>
> Key: HADOOP-14193
> URL: https://issues.apache.org/jira/browse/HADOOP-14193
> Project: Hadoop Common
> Issue Type: Improvement
> Components: common
> Reporter: Jose Miguel Arreola
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When running performance tests, we noticed that a lot of time is taken in resolving the host address.
> In our specific scenario, we saw the function org.apache.hadoop.security.SecurityUtil.getInetAddressByName taking a lot of time to resolve the hosts, and the same function is called a lot of times.
> I saw that org.apache.hadoop.yarn.server.resourcemanager.NodesListManager has a cached resolver already because of the same reason.
> So, the proposal is, to make this cache generic and use it to save some time in this functions that we already know, but have it available so the cache can be used anywhere else.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org