You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/12/20 23:04:00 UTC

[jira] [Updated] (HUDI-7244) Ensure ClosableIterator is propagated all the way to FileScanRDD

     [ https://issues.apache.org/jira/browse/HUDI-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HUDI-7244:
---------------------------------
    Labels: pull-request-available  (was: )

> Ensure ClosableIterator is propagated all the way to FileScanRDD
> ----------------------------------------------------------------
>
>                 Key: HUDI-7244
>                 URL: https://issues.apache.org/jira/browse/HUDI-7244
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: spark, spark-sql
>            Reporter: Jonathan Vexler
>            Assignee: Jonathan Vexler
>            Priority: Critical
>              Labels: pull-request-available
>
> CI tests are OOMing. One cause is that resources are not being freed from the new filegroup reader. After some code inspection, it was found that close is not being called in the HoodieFileGroupReaderIterator



--
This message was sent by Atlassian Jira
(v8.20.10#820010)