You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Ismaël Mejía (JIRA)" <ji...@apache.org> on 2019/01/29 15:58:00 UTC

[jira] [Resolved] (BEAM-6302) Allow setting compression codec in ParquetIO write

     [ https://issues.apache.org/jira/browse/BEAM-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ismaël Mejía resolved BEAM-6302.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 2.11.0

> Allow setting compression codec in ParquetIO write
> --------------------------------------------------
>
>                 Key: BEAM-6302
>                 URL: https://issues.apache.org/jira/browse/BEAM-6302
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-parquet
>            Reporter: Lukasz Gajowy
>            Assignee: Lukasz Gajowy
>            Priority: Critical
>             Fix For: 2.11.0
>
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> This is not possible now disallowing users to write compressed files. 
>  AvroParquetWriter setting the codec using [withCompressionCodec()|https://github.com/apache/parquet-mr/blob/1e0760a1f9c138e3cb66143f1c9fdf8ee2e8eef7/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetWriter.java#L401] method should be enough to solve this. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)