You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Solomon Duskis (JIRA)" <ji...@apache.org> on 2017/06/20 19:01:00 UTC

[jira] [Commented] (BEAM-2395) BigtableIO for Python SDK

    [ https://issues.apache.org/jira/browse/BEAM-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056286#comment-16056286 ] 

Solomon Duskis commented on BEAM-2395:
--------------------------------------

The python cloud bigtable client is missing some key features that the java client has relating to robustness and performance.  Specifically, the Java client has a "smart retries" feature that allows writes and reads to proceed despite temporary error conditions.  The python client also needs use the "bulk write" API for performance purposes. 

Without those features, a python Cloud Bigtable connector should not be considered ready for production.  FWIW, there are ongoing efforts to add those features.

> BigtableIO for Python SDK
> -------------------------
>
>                 Key: BEAM-2395
>                 URL: https://issues.apache.org/jira/browse/BEAM-2395
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-py
>            Reporter: Matthias Baetens
>            Assignee: Matthias Baetens
>              Labels: features
>
> Developing a read and write IO for BigTable for the Python SDK. 
> Working / design document can be found here: https://docs.google.com/document/d/1iXeQvIAsGjp9orleDy0o5ExU-eMqWesgvtt231UoaPg/edit?usp=sharing



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)