You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by azurezyq <gi...@git.apache.org> on 2017/10/14 01:45:17 UTC

[GitHub] beam pull request #3995: Add custom gcs temp location support to BigQueryIO.

GitHub user azurezyq opened a pull request:

    https://github.com/apache/beam/pull/3995

     Add custom gcs temp location support to BigQueryIO.

    BigQueryIO currently writes temp files to PipelineOptions.tempLocation, which is not ValueProvider-wrapped. Which makes the generated dataflow templates cannot be used across projects.
    In this PR, a new method withCustomGcsTempLocation() is introduced to solve the problem.
    ---


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/azurezyq/beam template

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/3995.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3995
    
----
commit 1b7446d9794b1c9bcc3528e229693f7b78cb6fd5
Author: Yunqing Zhou <zh...@zhouyunqing-macbookpro.roam.corp.google.com>
Date:   2017-10-13T22:52:18Z

    Add custom tempLocation support to BigQueryIO.

commit e9a74589eeadbd48c4ef3bef03f036141ab28a1d
Author: Yunqing Zhou <zh...@zhouyunqing.mtv.corp.google.com>
Date:   2017-10-14T01:21:21Z

    rename it from customTempLocation to customGcsLocation

commit 08ee48b6702d28813dc216bca3fb8d35a07b024d
Author: Yunqing Zhou <zh...@zhouyunqing.mtv.corp.google.com>
Date:   2017-10-14T01:42:45Z

    fix valueprovider bug

----


---

[GitHub] beam pull request #3995: Add custom gcs temp location support to BigQueryIO.

Posted by asfgit <gi...@git.apache.org>.

Github user asfgit closed the pull request at:

    https://github.com/apache/beam/pull/3995


---