You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2021/03/13 01:46:00 UTC

[jira] [Commented] (BEAM-8912) PreCommit_Python2_PVR_Flink_Commit flaky

    [ https://issues.apache.org/jira/browse/BEAM-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300677#comment-17300677 ] 

Kyle Weaver commented on BEAM-8912:
-----------------------------------

This has unfortunate become something of an umbrella bug encompassing a number of failure modes. 

- The original post included no failure information, and the Jenkins job has long since been garbage collected.
- A while back, I increased timeouts for Flink Python tests from 60s to 600s, so that shouldn't be an issue anymore.
- pullLicenses should be tracked in a separate bug.

Moreover, PreCommit_Python2_PVR_Flink_Commit doesn't even exist anymore, it's been superseded by beam_PreCommit_Python_PVR_Flink_Cron. The only recent failure for that job is because of BEAM-11837, which is not confined to this particular test suite and tracked elsewhere.

I'm closing this.



> PreCommit_Python2_PVR_Flink_Commit flaky
> ----------------------------------------
>
>                 Key: BEAM-8912
>                 URL: https://issues.apache.org/jira/browse/BEAM-8912
>             Project: Beam
>          Issue Type: Sub-task
>          Components: runner-flink
>            Reporter: Ahmet Altay
>            Priority: P1
>              Labels: flake, flaky, flaky-test
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> cc: [~angoenka]
> Logs: [https://builds.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Commit/1687/console]
> Error:
> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 \{PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult\{sum=59, count=1, min=59, max=59}))*19:44:02* [flink-runner-job-invoker] WARN org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService - Failed to remove job staging directory for token \{"sessionId":"job_b05dbc6c-00d8-4df1-9bf1-efdf35899fa6","basePath":"/tmp/flinktestdPbkyj"}: {}*19:44:02* java.io.FileNotFoundException: /tmp/flinktestdPbkyj/job_b05dbc6c-00d8-4df1-9bf1-efdf35899fa6/MANIFEST (No such file or directory)*19:44:02* 	at java.io.FileInputStream.open0(Native Method)*19:44:02* 	at java.io.FileInputStream.open(FileInputStream.java:195)*19:44:02* 	at java.io.FileInputStream.<init>(FileInputStream.java:138)*19:44:02* 	at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:118)*19:44:02* 	at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:82)*19:44:02* 	at org.apache.beam.sdk.io.FileSystems.open(FileSystems.java:252)*19:44:02* 	at org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService.loadManifest(BeamFileSystemArtifactRetrievalService.java:88)*19:44:02* 	at org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:92)*19:44:02* 	at org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:63)*19:44:02* 	at org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:201)*19:44:02* 	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.setState(JobInvocation.java:241)*19:44:02* 	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.access$200(JobInvocation.java:48)*19:44:02* 	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:110)*19:44:02* 	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:96)*19:44:02* 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)*19:44:02* 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*19:44:02* 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*19:44:02* 	at java.lang.Thread.run(Thread.java:748)*19:44:02* INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE*19:44:02* .INFO:__main__:removing conf dir: /tmp/flinktest-confGy17Mj*19:44:02*



--
This message was sent by Atlassian Jira
(v8.3.4#803005)