[jira] [Commented] (ARROW-9636) Error when using 'LZO' compression in write_table

["Joris Van den Bossche (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170651#comment-17170651 ] 

Joris Van den Bossche commented on ARROW-9636:
----------------------------------------------

[~Yohplala] thanks for the report!

LZO is in general supported by the Parquet format, but I think it is rather not yet supported by the Parquet C++ implementation. So in any case, the error message is confusing, and we should, as you mention, also not include it in the documentation. 

Contributions to update the docs are certainly welcome!

> Error when using 'LZO' compression in write_table
> -------------------------------------------------
>
>                 Key: ARROW-9636
>                 URL: https://issues.apache.org/jira/browse/ARROW-9636
>             Project: Apache Arrow
>          Issue Type: Bug
>            Reporter: Pierre
>            Priority: Trivial
>
> Hi,
> When trying to use 'LZO' codec in `pyarrow.parquet.write_table()` with below code, I get an error message indicating that 'LZO' is not available. However, this codec is mentioned as available in the doc [[https://arrow.apache.org/docs/python/generated/pyarrow.parquet.write_table.html]].
>  
> Code
> {code:python}
> from pyarrow import parquet as pq
> pq.write_table(data, file, compression='LZO')
> {code}
>  
> Error message
> {code:bash}
>  File "pyarrow/_parquet.pyx", line 1374, in pyarrow._parquet.ParquetWriter.write_table
> File "pyarrow/error.pxi", line 99, in pyarrow.lib.check_status
> OSError: Codec type LZO not supported in Parquet format
> {code}
>  
> I would suggest correcting the documentation, or making this codec available?
> Thanks for your support.
> Bests,
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)