You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/04/22 17:38:00 UTC

[jira] [Work logged] (BEAM-14357) Python unit test BigqueryFullResultStreamingMatcher.test__get_query_result_timeout fails locally

     [ https://issues.apache.org/jira/browse/BEAM-14357?focusedWorklogId=760967&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760967 ]

ASF GitHub Bot logged work on BEAM-14357:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 22/Apr/22 17:37
            Start Date: 22/Apr/22 17:37
    Worklog Time Spent: 10m 
      Work Description: Abacn opened a new pull request, #17447:
URL: https://github.com/apache/beam/pull/17447

   * patch bigquery.Client in test class
   
   **Please** add a meaningful description for your change here
   
   The original patch for '_query_with_retry' actually did not work. BigqueryMatcher._query_with_retry still get called. The test passed because timeout checking passed before the first call of this method. In local machine that runs fast enough, it may still make actual bigquery request and fail.
   
   ------------------------
   
   Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
   
    - [ ] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`).
    - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
    - [ ] Update `CHANGES.md` with noteworthy changes.
    - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
   
   See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier).
   
   To check the build health, please visit [https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md](https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md)
   
   GitHub Actions Tests Status (on master branch)
   ------------------------------------------------------------------------------------------------
   [![Build python source distribution and wheels](https://github.com/apache/beam/workflows/Build%20python%20source%20distribution%20and%20wheels/badge.svg?branch=master&event=schedule)](https://github.com/apache/beam/actions?query=workflow%3A%22Build+python+source+distribution+and+wheels%22+branch%3Amaster+event%3Aschedule)
   [![Python tests](https://github.com/apache/beam/workflows/Python%20tests/badge.svg?branch=master&event=schedule)](https://github.com/apache/beam/actions?query=workflow%3A%22Python+Tests%22+branch%3Amaster+event%3Aschedule)
   [![Java tests](https://github.com/apache/beam/workflows/Java%20Tests/badge.svg?branch=master&event=schedule)](https://github.com/apache/beam/actions?query=workflow%3A%22Java+Tests%22+branch%3Amaster+event%3Aschedule)
   
   See [CI.md](https://github.com/apache/beam/blob/master/CI.md) for more information about GitHub Actions CI.
   




Issue Time Tracking
-------------------

            Worklog Id:     (was: 760967)
    Remaining Estimate: 0h
            Time Spent: 10m

> Python unit test BigqueryFullResultStreamingMatcher.test__get_query_result_timeout fails locally
> ------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-14357
>                 URL: https://issues.apache.org/jira/browse/BEAM-14357
>             Project: Beam
>          Issue Type: Bug
>          Components: io-py-gcp
>    Affects Versions: 2.38.0
>         Environment: macOS M1 platform
>            Reporter: Yi Hu
>            Assignee: Yi Hu
>            Priority: P2
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Testing on local machine Command: 
> pytest -v apache_beam/io/gcp/tests/bigquery_matcher_test.py
> *E           google.api_core.exceptions.BadRequest: 400 POST [https://bigquery.googleapis.com/bigquery/v2/projects/some-project/jobs?prettyPrint=false:] ProjectId and DatasetId must be non-empty*
> *E*           
> *E           Location: None*
> *E           Job ID: 32fd52d1-324f-472f-b660-0d3bcc41d5a7*
> *1 failed, 6 passed in 106.84 seconds*
> ---------
> However, if run this test with xdist flag, it will pass:
> pytest -v -n 8 apache_beam/io/gcp/tests/bigquery_matcher_test.py
> {*}7 passed in 3.85 seconds{*}{*}{{*}}
> ---------
> Strangely, using xdist flag on all gcp tests, it fails:
> pytest -v -n 8 apache_beam/io/gcp/
> One test fails after minute long waiting:
> *E           google.api_core.exceptions.BadRequest: 400 POST [https://bigquery.googleapis.com/bigquery/v2/projects/some-project/jobs?prettyPrint=false:] ProjectId and DatasetId must be non-empty*
> *E*           
> *E           Location: None*
> *E           Job ID: 713e7c78-c693-4f87-a04d-2f0741d2ed67*
> *1 failed, 350 passed, 71 skipped, 233 warnings in 139.83 seconds*
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)