You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2025/08/20 03:02:00 UTC

[jira] [Updated] (SPARK-52582) Improve the memory usage of XML parser

     [ https://issues.apache.org/jira/browse/SPARK-52582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun updated SPARK-52582:
----------------------------------
        Parent: SPARK-51166
    Issue Type: Sub-task  (was: Improvement)

> Improve the memory usage of XML parser
> --------------------------------------
>
>                 Key: SPARK-52582
>                 URL: https://issues.apache.org/jira/browse/SPARK-52582
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 4.1.0
>            Reporter: Xiaonan Yang
>            Assignee: Xiaonan Yang
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.1.0
>
>
> Today, the XML parser is not memory efficient. It will load each XML record into memory first before parsing, which will OOM if the input XML record is pretty large. We want to improve the memory usage of the XML parser.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org