You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Chamikara Jayalath (JIRA)" <ji...@apache.org> on 2018/10/05 22:59:00 UTC

[jira] [Created] (BEAM-5670) Add more integration tests for BigQueryIO

Chamikara Jayalath created BEAM-5670:
----------------------------------------

             Summary: Add more integration tests for BigQueryIO
                 Key: BEAM-5670
                 URL: https://issues.apache.org/jira/browse/BEAM-5670
             Project: Beam
          Issue Type: Test
          Components: io-java-gcp, testing
            Reporter: Chamikara Jayalath
            Assignee: Pablo Estrada


Seems like we currently only have a single test that directly read using a query.

[https://github.com/apache/beam/blob/328129bf033bc6be16bc8e09af905f37b7516412/examples/java/src/test/java/org/apache/beam/examples/cookbook/BigQueryTornadoesIT.java]

 

We should consider adding more integration tests. For example,

 

(1) Read directly from a given table and a dataset.

(2) Read from a federated table.

(3) Read using BQ legacy SQL.

(4) Read from a table with nested/repeated fields.

(5) Read from non-standard BQ regions (for example, Japan).

 

Also, we should consider adding tests for BQ streaming writes once we have framework support for that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)