[jira] [Commented] (IMPALA-13449) Improve / Correct the Table Size in Catalog Web UI for External and Iceberg Tables

["Quanlong Huang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889627#comment-17889627 ] 

Quanlong Huang commented on IMPALA-13449:
-----------------------------------------

The sizes are estimated so it's expected to be different with the actualy mem usage. Here are the codes:
[https://github.com/apache/impala/blob/2535e79491078a0353dbeed1a094e91366906149/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java#L2467-L2506]

In short, it's estimated by "numPartitions * 2048 + numFiles * 500 + numBlocks * 150" in bytes. If the table has incremental stats, adds "numColumns * numPartitions * 200".

I think IcebergTable needs a different implementation since the 'partitionMap_' is not maintained in the same way as HdfsTable. CC [~gaborkaszab] 

> Improve / Correct the Table Size in Catalog Web UI for External and Iceberg Tables
> ----------------------------------------------------------------------------------
>
>                 Key: IMPALA-13449
>                 URL: https://issues.apache.org/jira/browse/IMPALA-13449
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Catalog
>            Reporter: Manish Maheshwari
>            Priority: Major
>
> Improve / Correct the Table Size in Catalog Web UI for External and Iceberg Tables. The current size shows tables extremely small and the logic needs to be refreshed for Iceberg tables



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org