You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Chamikara Jayalath (JIRA)" <ji...@apache.org> on 2019/04/22 23:21:00 UTC

[jira] [Commented] (BEAM-7063) Stage Dataflow runner harness in Dataflow FnApi Python test suites that run using an unreleased SDK.

    [ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823559#comment-16823559 ] 

Chamikara Jayalath commented on BEAM-7063:
------------------------------------------

Ah OK. Thanks. This bug was opened for post-commit failure but I see now that the title has changed.

> Stage Dataflow runner harness in Dataflow FnApi Python test suites that run using an unreleased SDK.
> ----------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-7063
>                 URL: https://issues.apache.org/jira/browse/BEAM-7063
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core, test-failures
>            Reporter: Chamikara Jayalath
>            Assignee: Luke Cwik
>            Priority: Critical
>             Fix For: 2.13.0
>
>          Time Spent: 5h
>  Remaining Estimate: 0h
>
> Seems like this was the first post-commit failure: [https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Python_Verify/7855/]
> (the one before this also failed but that looks like a flake)
>  
>  
> Looking at failed tests I noticed that some of the were due to failed Dataflow jobs. I noticed three issues.
> (1) Error in Dataflow jobs "This handler is only capable of dealing with urn:beam:sideinput:materialization:multimap:0.1 materializations but was asked to handle beam:side_input:multimap:v1 for PCollectionView with tag side0-FilterOutSpammers."
> [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_17_57_01-16397932959358575026?project=apache-beam-testing]
> [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_07_11-1342017143600540529?project=apache-beam-testing]
>  
> (2)  BigQuery job failures (possibly this is transient)
> [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_25_22-16437560120793921616?project=apache-beam-testing]
>  
> (3) Some batch Dataflow jobs timed out and were cancelled (possibly also transient).
>  
> (1) is probably due to [https://github.com/apache/beam/commit/684f8130284a7c7979773300d04e5473ca0ac8f3] 
>  
> cc: [~altay] [~lostluck] [~alanmyrvold]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)