You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Jonathan Vexler (Jira)" <ji...@apache.org> on 2024/01/25 04:14:00 UTC

[jira] [Closed] (HUDI-7244) Ensure ClosableIterator is propagated all the way to FileScanRDD

     [ https://issues.apache.org/jira/browse/HUDI-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Vexler closed HUDI-7244.
---------------------------------
    Resolution: Fixed

> Ensure ClosableIterator is propagated all the way to FileScanRDD
> ----------------------------------------------------------------
>
>                 Key: HUDI-7244
>                 URL: https://issues.apache.org/jira/browse/HUDI-7244
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: spark, spark-sql
>            Reporter: Jonathan Vexler
>            Assignee: Jonathan Vexler
>            Priority: Critical
>              Labels: pull-request-available
>
> CI tests are OOMing. One cause is that resources are not being freed from the new filegroup reader. After some code inspection, it was found that close is not being called in the HoodieFileGroupReaderIterator



--
This message was sent by Atlassian Jira
(v8.20.10#820010)