You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2021/05/15 17:59:03 UTC

[jira] [Updated] (BEAM-10859) BigQuerySource: Allow configuration of temporary dataset project

     [ https://issues.apache.org/jira/browse/BEAM-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kenneth Knowles updated BEAM-10859:
-----------------------------------
    Resolution: Fixed
        Status: Resolved  (was: Resolved)

Hello! Due to a bug in our Jira configuration, this issue had status:Resolved but resolution:Unresolved.

I am bulk editing these issues to have resolution:Fixed

If a different resolution is appropriate, please change it. To do this, click the "Resolve" button (you can do this even for closed issues) and set the Resolution field to the right value.

> BigQuerySource: Allow configuration of temporary dataset project
> ----------------------------------------------------------------
>
>                 Key: BEAM-10859
>                 URL: https://issues.apache.org/jira/browse/BEAM-10859
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-py-gcp
>            Reporter: Frank Zhao
>            Priority: P3
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> There are some uses cases that require temporary datasets created when using beam.io.BigQuerySource to be in a different GCP project (e.g service account permissions, billing).
> We could make the project where temporary datasets configurable, so that the temp dataset is created in a user specified project. Example:
> {code:java}
> pipeline = p | "Read from BQ source" >> beam.io.Read(beam.io.BigQuerySource(
>     query=q,
>     use_standard_sql=True,
>     project='dataflow-project',
>     temp_dataset_project='bigquery-project'))
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)