You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Lukasz Gajowy (JIRA)" <ji...@apache.org> on 2018/10/29 15:25:00 UTC

[jira] [Created] (BEAM-5906) Remove pipeline for publishing nexmark results to bigQuery and publish using BigQuery API only

Lukasz Gajowy created BEAM-5906:
-----------------------------------

             Summary: Remove pipeline for publishing nexmark results to bigQuery and publish using BigQuery API only
                 Key: BEAM-5906
                 URL: https://issues.apache.org/jira/browse/BEAM-5906
             Project: Beam
          Issue Type: Improvement
          Components: examples-nexmark
            Reporter: Lukasz Gajowy
            Assignee: Lukasz Gajowy


There's no need to start a separate pipeline for uploading metrics results from Nexmark suites to BigQuery. We can use an API designed for that and place it in test-utils. Thanks to that: 

 - it won't start a separate pipeline every time it publishes results
 - other suites will be able to use that code
 - We will not face problems like special long to int conversion due to problems in BigQueryIO (eg. BEAM-4734) because we will use a thin API instead.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)