You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/05/21 17:20:00 UTC

[jira] [Work logged] (BEAM-1909) BigQuery read transform fails for DirectRunner when querying non-US regions

     [ https://issues.apache.org/jira/browse/BEAM-1909?focusedWorklogId=104131&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-104131 ]

ASF GitHub Bot logged work on BEAM-1909:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 21/May/18 17:19
            Start Date: 21/May/18 17:19
    Worklog Time Spent: 10m 
      Work Description: DannyLee12 opened a new pull request #5435: [BEAM-1909] Fixes BigQuery read transform fails for DirectRunner when querying non-US regions
URL: https://github.com/apache/beam/pull/5435
 
 
   Added a fix to the Issue metioned above.
   
   Includes
   ---
   - Add regex to get projectid, datasetid and table id from both legacy and standard sql when project is provided
   - Add regex to get datasetId and tableId from both legacy and standardsql when project is NOT provided.
   - Add ability to use project attribute that already existed on BigQuerySource class
   - If project is not provided at all, do not break the existing distributions. Therefore, nothing happens and the tables are created in location=None. This defaults back to US on directRunner but *should* work when running in dataflow.
   
   ------------------------
   
   Follow this checklist to help us incorporate your contribution quickly and easily:
   
   It will help us expedite review of your Pull Request if you tag someone (e.g. `@username`) to look at it.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 104131)
            Time Spent: 10m
    Remaining Estimate: 0h

> BigQuery read transform fails for DirectRunner when querying non-US regions
> ---------------------------------------------------------------------------
>
>                 Key: BEAM-1909
>                 URL: https://issues.apache.org/jira/browse/BEAM-1909
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>            Reporter: Chamikara Jayalath
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> See: http://stackoverflow.com/questions/42135002/google-dataflow-cannot-read-and-write-in-different-locations-python-sdk-v0-5-5/42144748?noredirect=1#comment73621983_42144748
> This should be fixed by creating the temp dataset and table in the correct region.
> cc: [~sb2nov]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)