You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/02/05 01:59:00 UTC

[jira] [Updated] (ARROW-2090) Add context manager methods to ParquetWriter

     [ https://issues.apache.org/jira/browse/ARROW-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated ARROW-2090:
----------------------------------
    Labels: pull-request-available  (was: )

> Add context manager methods to ParquetWriter
> --------------------------------------------
>
>                 Key: ARROW-2090
>                 URL: https://issues.apache.org/jira/browse/ARROW-2090
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>            Reporter: Alec Posney
>            Priority: Minor
>              Labels: pull-request-available
>
> Add the ability to use python {{with}} syntax on the {{ParquetWriter}} object.
> For example:
> {code:python}
> with pq.ParquetWriter(foo, schema) as writer:
>     writer.write_table(table)
> {code}
> The benefit of this syntax is that it removes the chances of you writing out a partial (invalid) parquet file, which is currently possible if you forget to call the close method, or more likely the close method is not called due to an exception being thrown. 
> It should still be possible to use the previous syntax for backwards compatibility and fine grained control reasons.
> Similarly, the {{parquet}} module level {{write_table}} method should be able to use the new syntax without changing previous behaviour. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)