You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Rok Mihevc (Jira)" <ji...@apache.org> on 2023/01/11 07:17:04 UTC
[jira] [Updated] (ARROW-1769) Python: pyarrow.parquet.write_to_dataset creates cyclic references
[ https://issues.apache.org/jira/browse/ARROW-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rok Mihevc updated ARROW-1769:
------------------------------
External issue URL: https://github.com/apache/arrow/issues/17769
> Python: pyarrow.parquet.write_to_dataset creates cyclic references
> ------------------------------------------------------------------
>
> Key: ARROW-1769
> URL: https://issues.apache.org/jira/browse/ARROW-1769
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 0.7.1
> Reporter: Uwe Korn
> Priority: Major
> Fix For: 0.8.0
>
>
> See https://github.com/apache/arrow/issues/1285 for the initial issue. Having cyclic references is a valid state in Python as they can be cleaned up by the garbage collector. But as the garbage collector normally runs at a point which is not clear to the user and we deal here normally with larger objects, we should get rid of the cyclic reference to evict data as soon as possible from main memory.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)