You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Solomon Duskis (JIRA)" <ji...@apache.org> on 2017/06/20 19:01:00 UTC
[jira] [Commented] (BEAM-2395) BigtableIO for Python SDK
[ https://issues.apache.org/jira/browse/BEAM-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056286#comment-16056286 ]
Solomon Duskis commented on BEAM-2395:
--------------------------------------
The python cloud bigtable client is missing some key features that the java client has relating to robustness and performance. Specifically, the Java client has a "smart retries" feature that allows writes and reads to proceed despite temporary error conditions. The python client also needs use the "bulk write" API for performance purposes.
Without those features, a python Cloud Bigtable connector should not be considered ready for production. FWIW, there are ongoing efforts to add those features.
> BigtableIO for Python SDK
> -------------------------
>
> Key: BEAM-2395
> URL: https://issues.apache.org/jira/browse/BEAM-2395
> Project: Beam
> Issue Type: New Feature
> Components: sdk-py
> Reporter: Matthias Baetens
> Assignee: Matthias Baetens
> Labels: features
>
> Developing a read and write IO for BigTable for the Python SDK.
> Working / design document can be found here: https://docs.google.com/document/d/1iXeQvIAsGjp9orleDy0o5ExU-eMqWesgvtt231UoaPg/edit?usp=sharing
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)