You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@parquet.apache.org by "Atour Mousavi Gourabi (Jira)" <ji...@apache.org> on 2024/03/14 14:23:00 UTC

[jira] [Created] (PARQUET-2449) Writing using LocalOutputFile creates a large buffer

Atour Mousavi Gourabi created PARQUET-2449:
----------------------------------------------

             Summary: Writing using LocalOutputFile creates a large buffer
                 Key: PARQUET-2449
                 URL: https://issues.apache.org/jira/browse/PARQUET-2449
             Project: Parquet
          Issue Type: Bug
          Components: parquet-mr
            Reporter: Atour Mousavi Gourabi


LocalOutputFile uses a large buffer to write Parquet files. In low-memory environments this causes OOMs. See the discussion under apache/parquet-mr#1111 for more details.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org