You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Mark Liu (Jira)" <ji...@apache.org> on 2019/09/09 19:26:00 UTC

[jira] [Updated] (BEAM-7906) Perf regression in SQL Query3 in Dataflow

     [ https://issues.apache.org/jira/browse/BEAM-7906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Liu updated BEAM-7906:
---------------------------
    Fix Version/s:     (was: 2.16.0)
                   2.17.0

> Perf regression in SQL Query3 in Dataflow
> -----------------------------------------
>
>                 Key: BEAM-7906
>                 URL: https://issues.apache.org/jira/browse/BEAM-7906
>             Project: Beam
>          Issue Type: Bug
>          Components: dsl-sql, runner-dataflow
>            Reporter: Anton Kedin
>            Priority: Major
>             Fix For: 2.17.0
>
>         Attachments: dataflow.png, direct.png
>
>
> Nexmark shows perf regression in SQL Query3 starting on July 30 2019: https://apache-beam-testing.appspot.com/explore?dashboard=5670405876482048
> There doesn't seem to be a lot of changes to SQL around that date and the one that was there doesn't seem relevan to the query: https://github.com/apache/beam/commits/master/sdks/java/extensions/sql
> Direct runner shows a slight perf decrease as well: https://apache-beam-testing.appspot.com/explore?dashboard=5084698770407424 while Spark runner doesn't: https://apache-beam-testing.appspot.com/explore?dashboard=5138380291571712
> The query in question is a join with a simple filter condition: https://github.com/apache/beam/blob/b8aa8486f336df6fc9cf581f29040194edad3b87/sdks/java/testing/nexmark/src/main/java/org/apache/beam/sdk/nexmark/queries/sql/SqlQuery3.java#L69
> Other queries don't seem to be affected



--
This message was sent by Atlassian Jira
(v8.3.2#803003)