[jira] [Comment Edited] (BEAM-12793) beam_PostRelease_NightlySnapshot failed: 404 table not found

["Valentyn Tymofieiev (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-12793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17464890#comment-17464890 ] 

Valentyn Tymofieiev edited comment on BEAM-12793 at 12/24/21, 4:34 AM:
-----------------------------------------------------------------------

This task  fails consistently for me on 2.35.0 release branch.

Running against older release branch fails with a different error (2.34.0-SNAPSHOT artifacts are no longer available), so can't tell how recent is this error, but probably not recent.

I am not seeing any useful stacktraces that indicate what the error actually is.

It seems that the failing example is the `LeaderBoard example on DirectRunner`. Root cause is not clear. Logs say:
{noformat}
***Warning! You are not using service account credentials to authenticate.    
You need to use service account credentials for this example,    
since user-level credentials do not have enough pubsub quota,    
and so you will run out of PubSub quota very quickly.    
See https://developers.google.com/identity/protocols/application-default-credentials.    
[ERROR] Failed command{noformat}
Gradle scan:

[https://scans.gradle.com/s/ko4gmxtx7cema/console-log?task=:runners:direct-java:runMobileGamingJavaDirect]    


was (Author: tvalentyn):
This task  fails consistently for me on 2.35.0 release branch.

Running against older release branch fails with a different error (2.34.0-SNAPSHOT artifacts are no longer available), so can't tell how recent is this error, but probably not recent.

I am not seeing any Dataflow-related errors, or any useful stacktraces that indicate what the error actually is.

It seems that the failing example is the `LeaderBoard example on DirectRunner`. Root cause is not clear. Logs say:
{noformat}
***Warning! You are not using service account credentials to authenticate.    
You need to use service account credentials for this example,    
since user-level credentials do not have enough pubsub quota,    
and so you will run out of PubSub quota very quickly.    
See https://developers.google.com/identity/protocols/application-default-credentials.    
[ERROR] Failed command{noformat}
Gradle scan:

https://scans.gradle.com/s/ko4gmxtx7cema/console-log?task=:runners:direct-java:runMobileGamingJavaDirect    

> beam_PostRelease_NightlySnapshot failed: 404 table not found
> ------------------------------------------------------------
>
>                 Key: BEAM-12793
>                 URL: https://issues.apache.org/jira/browse/BEAM-12793
>             Project: Beam
>          Issue Type: Bug
>          Components: test-failures
>            Reporter: Kyle Weaver
>            Assignee: Kenneth Knowles
>            Priority: P1
>              Labels: currently-failing, flake
>
> Task :runners:direct-java:runMobileGamingJavaDirect is failing (or severely flaking).
> There are a bunch of similar 404 errors for the tables used in the Dataflow runner tests, but the Dataflow runner test doesn't appear to be the one that's actually failing.
> https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1470/console
> {code}
> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java (default-cli) on project word-count-beam: An exception occured while executing the Java class. java.lang.RuntimeException: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
> [ERROR] POST https://bigquery.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/beam_postrelease_mobile_gaming/tables/leaderboard_DirectRunner_team/insertAll?prettyPrint=false
> [ERROR] {
> [ERROR] "code" : 404,
> [ERROR] "errors" : [ {
> [ERROR] "domain" : "global",
> [ERROR] "message" : "Not found: table Table is deleted: 844138762903:beam_postrelease_mobile_gaming.leaderboard_DirectRunner_team",
> [ERROR] "reason" : "notFound"
> [ERROR] } ],
> [ERROR] "message" : "Not found: table Table is deleted: 844138762903:beam_postrelease_mobile_gaming.leaderboard_DirectRunner_team",
> [ERROR] "status" : "NOT_FOUND"
> [ERROR] }
> {code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)