You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Valentyn Tymofieiev (Jira)" <ji...@apache.org> on 2020/08/20 17:13:01 UTC
[jira] [Updated] (BEAM-1251) Python 3 Support
[ https://issues.apache.org/jira/browse/BEAM-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Valentyn Tymofieiev updated BEAM-1251:
--------------------------------------
Description:
h1. FAQ
Does Apache Beam support Python 3?
- *Yes!*
Is there any remaining work?
- We continue to improve user experience of Python 3 users, add support for new Python minor versions, and phase out support of old ones.
Check out the Python SDK roadmap on [how to contribute or report a Python 3 issue|https://beam.apache.org/roadmap/python-sdk/#python-3-support]!
Which SDK version should I use?
- For best experience, use the latest released SDK. For summary of Py3-related changes, read this thread.
Help! I am getting a pickling error in StockUnpickler.find_class() on Python 3.
- Does the error happens in load_session call? See BEAM-6158 .
- Do you use Beam SDK less than 2.17.0? See BEAM-8651.
My Avro Sink no longer works.
- Beam switched to use FastAvro as a default library on Python 3. The fastavro-based Avro sink expects schema as a dictionary, while the avro-python3-based Avro Sink expects a schema that was previously parsed by avro.schema.parse_schema. Fastavro will not accept a schema parsed by avro-python3, so make sure you pass the correct schema. See: BEAM-10769.
My streaming pipelines are stuck on Python 3.
- Do you use Beam SDK less than 2.17.0? If so please upgrade to 2.17.0. See BEAM-8651.
was:
FAQ
Does Apache Beam support Python 3?
- *Yes!*
Is there any remaining work?
- We continue to improve user experience of Python 3 users, add support for new Python minor versions, and phase out support of old ones.
Check out the Python SDK roadmap on [how to contribute or report a Python 3 issue|https://beam.apache.org/roadmap/python-sdk/#python-3-support]!
Which SDK version should I use?
- For best experience, use the latest released SDK. For summary of Py3-related changes, read this thread.
Help! I am getting a pickling error in StockUnpickler.find_class() on Python 3.
- Does the error happens in load_session call? See BEAM-6158 .
- Do you use Beam SDK less than 2.17.0? See BEAM-8651.
My streaming pipelines are stuck on Python 3:
- Do you use Beam SDK less than 2.17.0? If so please upgrade to 2.17.0. See BEAM-8651.
> Python 3 Support
> ----------------
>
> Key: BEAM-1251
> URL: https://issues.apache.org/jira/browse/BEAM-1251
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Eyad Sibai
> Assignee: Valentyn Tymofieiev
> Priority: P2
> Fix For: 2.11.0
>
> Time Spent: 30h 10m
> Remaining Estimate: 0h
>
> h1. FAQ
> Does Apache Beam support Python 3?
> - *Yes!*
> Is there any remaining work?
> - We continue to improve user experience of Python 3 users, add support for new Python minor versions, and phase out support of old ones.
> Check out the Python SDK roadmap on [how to contribute or report a Python 3 issue|https://beam.apache.org/roadmap/python-sdk/#python-3-support]!
> Which SDK version should I use?
> - For best experience, use the latest released SDK. For summary of Py3-related changes, read this thread.
> Help! I am getting a pickling error in StockUnpickler.find_class() on Python 3.
> - Does the error happens in load_session call? See BEAM-6158 .
> - Do you use Beam SDK less than 2.17.0? See BEAM-8651.
> My Avro Sink no longer works.
> - Beam switched to use FastAvro as a default library on Python 3. The fastavro-based Avro sink expects schema as a dictionary, while the avro-python3-based Avro Sink expects a schema that was previously parsed by avro.schema.parse_schema. Fastavro will not accept a schema parsed by avro-python3, so make sure you pass the correct schema. See: BEAM-10769.
> My streaming pipelines are stuck on Python 3.
> - Do you use Beam SDK less than 2.17.0? If so please upgrade to 2.17.0. See BEAM-8651.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)