You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2025/03/25 03:26:00 UTC

[jira] [Updated] (HUDI-9219) Follow up on all usages of Closeable iterator in spark tasks

     [ https://issues.apache.org/jira/browse/HUDI-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan updated HUDI-9219:
--------------------------------------
    Fix Version/s: 1.0.2

> Follow up on all usages of Closeable iterator in spark tasks
> ------------------------------------------------------------
>
>                 Key: HUDI-9219
>                 URL: https://issues.apache.org/jira/browse/HUDI-9219
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: writer-core
>            Reporter: sivabalan narayanan
>            Priority: Major
>             Fix For: 1.0.2
>
>
> Spark may not guarantee to call close just bcoz an iterator is closable. so, lets ensure we follow up to analyze all such usages and ensure resources like file group reader are closed properly when spark tasks close



--
This message was sent by Atlassian Jira
(v8.20.10#820010)