You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Andy Grove (Jira)" <ji...@apache.org> on 2019/10/08 20:12:00 UTC
[jira] [Resolved] (ARROW-6803) [Rust] [DataFusion] Aggregate
queries are slower with new physical query plan
[ https://issues.apache.org/jira/browse/ARROW-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Grove resolved ARROW-6803.
-------------------------------
Resolution: Fixed
Issue resolved by pull request 5590
[https://github.com/apache/arrow/pull/5590]
> [Rust] [DataFusion] Aggregate queries are slower with new physical query plan
> -----------------------------------------------------------------------------
>
> Key: ARROW-6803
> URL: https://issues.apache.org/jira/browse/ARROW-6803
> Project: Apache Arrow
> Issue Type: Sub-task
> Components: Rust, Rust - DataFusion
> Affects Versions: 1.0.0
> Reporter: Andy Grove
> Assignee: Andy Grove
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> executing direct from logical plan:
> {code:java}
> aggregate_query_no_group_by
> time: [13.096 us 13.187 us 13.294 us]
> change: [-88.712% -88.554% -88.398%] (p = 0.00 < 0.05)
> Performance has improved.
> Found 5 outliers among 100 measurements (5.00%)
> 5 (5.00%) high mildaggregate_query_group_by
> time: [44.153 us 44.816 us 45.541 us]
> change: [-77.984% -77.485% -77.009%] (p = 0.00 < 0.05)
> Performance has improved.
> Found 4 outliers among 100 measurements (4.00%)
> 4 (4.00%) high mildaggregate_query_group_by_with_filter
> time: [75.383 us 76.076 us 76.817 us]
> change: [-72.345% -71.811% -71.097%] (p = 0.00 < 0.05)
> Performance has improved.
> Found 16 outliers among 100 measurements (16.00%)
> {code}
> executing from physical plan:
> {code:java}
> aggregate_query_no_group_by
> time: [112.13 us 113.63 us 115.26 us]
> change: [-3.8005% -2.0342% -0.3584%] (p = 0.02 < 0.05)
> Change within noise threshold.
> Found 1 outliers among 100 measurements (1.00%)
> 1 (1.00%) high mildaggregate_query_group_by
> time: [195.12 us 198.63 us 202.39 us]
> change: [-1.3814% +1.0612% +3.5732%] (p = 0.40 > 0.05)
> No change in performance detected.
> Found 6 outliers among 100 measurements (6.00%)
> 4 (4.00%) high mild
> 2 (2.00%) high severeaggregate_query_group_by_with_filter
> time: [270.69 us 272.18 us 273.63 us]
> change: [-2.1583% -0.4877% +1.0161%] (p = 0.56 > 0.05)
> No change in performance detected.
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)