You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2020/11/09 20:54:00 UTC

[jira] [Updated] (BEAM-11211) Support multiple major pyarrow versions

     [ https://issues.apache.org/jira/browse/BEAM-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kenneth Knowles updated BEAM-11211:
-----------------------------------
    Status: Open  (was: Triage Needed)

> Support multiple major pyarrow versions
> ---------------------------------------
>
>                 Key: BEAM-11211
>                 URL: https://issues.apache.org/jira/browse/BEAM-11211
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-py-core
>            Reporter: Brian Hulette
>            Assignee: Brian Hulette
>            Priority: P2
>
> We should support using ParquetIO with multiple pyarrow versions, up to 2.x.
> Specific actions:
> - There's a limitation in 1.x where it can't write LZ4 compression, we should catch attempts to do this at construction time and raise a useful error (See ARROW-9424).
> - Add the ability to test with different pyarrow versions and run in PostCommit to verify.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)