[jira] [Commented] (BEAM-3198) Improve error message in BigqueryIO when withNumFileShards is not specified

["AJ (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254302#comment-16254302 ] 

AJ commented on BEAM-3198:
--------------------------

My write to Biguqery is similar to the following:
{code}
unboundedPcollection.apply("Write to BQ",
                           BigQueryIO.<...>write()
                                 .to(...)
                                 .withFormatFunction(...)
                                 .withTriggeringFrequency(Duration.standardMinutes(1))
                                .withMethod(BigQueryIO.Write.Method.FILE_LOADS)                               .
{code}
And this throws "Exception in thread "main" java.lang.IllegalArgumentException".
Adding .withNumFileShards(...) resolves it.

> Improve error message in BigqueryIO when withNumFileShards is not specified
> ---------------------------------------------------------------------------
>
>                 Key: BEAM-3198
>                 URL: https://issues.apache.org/jira/browse/BEAM-3198
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-gcp
>            Reporter: Luke Cwik
>            Assignee: Chamikara Jayalath
>            Priority: Minor
>
> Reported in [https://lists.apache.org/thread.html/88c8da5eaf34ab1c7dc83372e0e2b1c31426b22aa4844b65b54ad16c@%3Cuser.beam.apache.org%3E]
> I am trying to use Method.FILE_LOADS for loading data into BQ in my streaming pipeline using 2.2.0. It looks like withNumFileShards needs to be also set for using this. 
> * Can we throw a better error message when it is not set? The exception thrown by the pipeline if this is not set is "Exception in thread "main" java.lang.IllegalArgumentException" without any message.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)