You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kasia Kucharczyk (JIRA)" <ji...@apache.org> on 2018/11/05 15:05:00 UTC

[jira] [Commented] (BEAM-5778) Add integrations of Metrics API to Big Query for SyntheticSources load tests in Python SDK

    [ https://issues.apache.org/jira/browse/BEAM-5778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675283#comment-16675283 ] 

Kasia Kucharczyk commented on BEAM-5778:
----------------------------------------

The load tests utilities were extended with methods which parse distributions and counters metrics and saves it to Big Query.

Load tests have an extra pipeline option with `project_id` to point for Big Query. Each load tests passes dictionary with metrics schema. Then module is changing it to BigQuery schema and prepares dataset and table. After test is done, metrics are sent to BigQuery.

> Add integrations of Metrics API to Big Query for SyntheticSources load tests in Python SDK
> ------------------------------------------------------------------------------------------
>
>                 Key: BEAM-5778
>                 URL: https://issues.apache.org/jira/browse/BEAM-5778
>             Project: Beam
>          Issue Type: Improvement
>          Components: testing
>            Reporter: Kasia Kucharczyk
>            Assignee: Kasia Kucharczyk
>            Priority: Major
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Right now Metrics API collects basic metrics of load tests of SyntheticSources (Python SDK). It should be collected in BigQuery for presenting it on performance dashboards.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)