You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Wout Scheepers (JIRA)" <ji...@apache.org> on 2018/11/16 09:13:00 UTC
[jira] [Commented] (BEAM-5191) Add support for writing to BigQuery
clustered tables
[ https://issues.apache.org/jira/browse/BEAM-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689188#comment-16689188 ]
Wout Scheepers commented on BEAM-5191:
--------------------------------------
Implemented PR: https://github.com/apache/beam/pull/7061
> Add support for writing to BigQuery clustered tables
> ----------------------------------------------------
>
> Key: BEAM-5191
> URL: https://issues.apache.org/jira/browse/BEAM-5191
> Project: Beam
> Issue Type: Improvement
> Components: io-java-gcp
> Affects Versions: 2.6.0
> Reporter: Robert Sahlin
> Assignee: Wout Scheepers
> Priority: Minor
> Labels: features, newbie
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Google recently added support for clustered tables in BigQuery. It would be useful to set clustering columns the same way as for partitioning. It should support multiple fields (4) for clustering.
> For example:
> [BigQueryIO.Write|https://beam.apache.org/documentation/sdks/javadoc/2.6.0/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.Write.html]<[T|https://beam.apache.org/documentation/sdks/javadoc/2.6.0/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.Write.html]> .withClustering(new Clustering().setField("productId").setType("STRING"))
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)