You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2020/08/12 00:16:00 UTC
[jira] [Updated] (BEAM-10681) Spark portable runner should mark
metrics supported
[ https://issues.apache.org/jira/browse/BEAM-10681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kyle Weaver updated BEAM-10681:
-------------------------------
Status: Open (was: Triage Needed)
> Spark portable runner should mark metrics supported
> ---------------------------------------------------
>
> Key: BEAM-10681
> URL: https://issues.apache.org/jira/browse/BEAM-10681
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: P2
> Labels: portability-spark
>
> For some reason, the Spark portable runner marks metrics as not enabled, even though metrics are actually supported [1]. This field is not widely used, but it does affect whether TestPipeline checks the number of PAsserts that succeeded [2].
> [1] https://github.com/apache/beam/blob/56193a66fd17e3d8e40d486ee113201c2661070d/runners/spark/src/main/java/org/apache/beam/runners/spark/SparkPipelineRunner.java#L113
> [2] https://github.com/apache/beam/blob/ef533ee9ff2511d37563e01f0430de0ec1e61004/sdks/java/core/src/main/java/org/apache/beam/sdk/testing/TestPipeline.java#L495
--
This message was sent by Atlassian Jira
(v8.3.4#803005)