You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ismaël Mejía (JIRA)" <ji...@apache.org> on 2019/01/27 21:47:00 UTC
[jira] [Assigned] (BEAM-3874) Switch AvroIO sink default codec to
Snappy
[ https://issues.apache.org/jira/browse/BEAM-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ismaël Mejía reassigned BEAM-3874:
----------------------------------
Assignee: Marian Dvorsky
> Switch AvroIO sink default codec to Snappy
> ------------------------------------------
>
> Key: BEAM-3874
> URL: https://issues.apache.org/jira/browse/BEAM-3874
> Project: Beam
> Issue Type: Improvement
> Components: io-java-avro
> Reporter: Marian Dvorsky
> Assignee: Marian Dvorsky
> Priority: Minor
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> AvroIO currently uses CodecFactory.deflateCodec(6) as the default codec for writes.
> That compresses well, but is quite expensive.
> Snappy codec offers sparser, but much faster compression, and is typically a better CPU/storage tradeoff except for very long lived files.
> We should consider switching the default to Snappy.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)