You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "VladRodionov (via GitHub)" <gi...@apache.org> on 2024/08/27 18:31:22 UTC

Re: [I] ICEBERG performance is slow when querying tables with a large number of partitions. [iceberg]

VladRodionov commented on issue #8161:
URL: https://github.com/apache/iceberg/issues/8161#issuecomment-2313246358

   Is this  **Big** or **Small** data technology?  Let us say table size is 300TB.  With 400K partitions, average partition size is 750MB, which looks normal to me. 3PB tables? I know they exist.  I think that the problem of large number of partitions, large size of the metadata must be eventually addressed by Iceberg community.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org