You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kasia Kucharczyk (Jira)" <ji...@apache.org> on 2019/11/12 08:24:00 UTC

[jira] [Updated] (BEAM-6335) GroupByKey uses data insertion pipeline in streaming tests

     [ https://issues.apache.org/jira/browse/BEAM-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kasia Kucharczyk updated BEAM-6335:
-----------------------------------
    Description: 
Uses prepared Java Data Insertion Pipeline to update GroupByKey in Python to load test streaming.

This task contains following steps:
 # Create GroupByKey streaming test that accepts bytes
 # To stop test after arrived messages it is required to add a matcher. The matcher should work on number of messages because in case of load testing it would be difficult to compare big load of bytes (also casting bytes to string to compare load would be difficult).
 # All data is generated by SyntheticDataPublisher.java, which is sending bytes produced by synthetic source to PubSub. PubSub is used as a streaming source for the Python test.

  was:Uses prepared Java Data Insertion Pipeline to update GroupByKey in Python to load test streaming.


> GroupByKey uses data insertion pipeline in streaming tests
> ----------------------------------------------------------
>
>                 Key: BEAM-6335
>                 URL: https://issues.apache.org/jira/browse/BEAM-6335
>             Project: Beam
>          Issue Type: Sub-task
>          Components: testing
>            Reporter: Kasia Kucharczyk
>            Assignee: Kasia Kucharczyk
>            Priority: Major
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> Uses prepared Java Data Insertion Pipeline to update GroupByKey in Python to load test streaming.
> This task contains following steps:
>  # Create GroupByKey streaming test that accepts bytes
>  # To stop test after arrived messages it is required to add a matcher. The matcher should work on number of messages because in case of load testing it would be difficult to compare big load of bytes (also casting bytes to string to compare load would be difficult).
>  # All data is generated by SyntheticDataPublisher.java, which is sending bytes produced by synthetic source to PubSub. PubSub is used as a streaming source for the Python test.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)