You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Masatake Iwasaki (Jira)" <ji...@apache.org> on 2022/05/23 05:17:00 UTC

[jira] [Updated] (HADOOP-18129) Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem

     [ https://issues.apache.org/jira/browse/HADOOP-18129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Masatake Iwasaki updated HADOOP-18129:
--------------------------------------
    Fix Version/s: 2.10.2

> Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem
> ----------------------------------------------------------------------------------
>
>                 Key: HADOOP-18129
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18129
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Abhishek Das
>            Assignee: Abhishek Das
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.4.0, 2.10.2, 3.3.4
>
>          Time Spent: 2h 50m
>  Remaining Estimate: 0h
>
> Around 40k instances of INodeLink each of which is taking memory ranging from 1680bytes to 1160bytes. Multiplying 40k with 1160bytes will give us approximate 45mb.
> With changing from URI to String in INodeLink the memory consumed by each of the INodeLink objects has reduced from ~1160 bytes to ~320 bytes. Overall size becomes (40k X 320) 12mb



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org