[jira] [Comment Edited] (BEAM-8236) BigQueryIO doesn't honor WRITE_TRUNCATE with DynamicDestinations after the first pane

["Luke Cwik (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938124#comment-16938124 ] 

Luke Cwik edited comment on BEAM-8236 at 9/25/19 11:10 PM:
-----------------------------------------------------------

It turns out that the dynamic table destination is the key and hence should always have a first pane which is responsible for truncating the destination. It should never be the case that the dynamic destination will start with a pane index > 0

 

Much more details on BEAM-3772


was (Author: lcwik):
It turns out that the dynamic table destination is the key and hence should always have a first pane which is responsible for truncating the destination. It should never be the case that the dynamic destination will start with a pane index > 0

> BigQueryIO doesn't honor WRITE_TRUNCATE with DynamicDestinations after the first pane
> -------------------------------------------------------------------------------------
>
>                 Key: BEAM-8236
>                 URL: https://issues.apache.org/jira/browse/BEAM-8236
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-gcp
>            Reporter: Luke Cwik
>            Assignee: Luke Cwik
>            Priority: Major
>             Fix For: Not applicable
>
>
> If the first pane does not contain elements for the dynamic destination then the table is not truncated. [Future writes will have a write disposition of append|https://github.com/apache/beam/blob/ba5c9def3967d9e3348ccf8563c2b54196fbd1ad/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L201].



--
This message was sent by Atlassian Jira
(v8.3.4#803005)